Jul 23 01:28:07.043962 ip-10-0-129-17 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 01:28:07.511062 ip-10-0-129-17 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 01:28:07.511062 ip-10-0-129-17 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 01:28:07.511062 ip-10-0-129-17 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 01:28:07.511062 ip-10-0-129-17 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 01:28:07.511062 ip-10-0-129-17 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 01:28:07.512931 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.511104    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517724    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517738    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517745    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517750    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517754    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517759    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517763    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517767    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517771    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517775    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517780    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517786    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517791    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517795    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517799    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517803    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517807    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517811    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517815    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.563928 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517819    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517823    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517826    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517830    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517834    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517838    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517842    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517846    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517850    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517854    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517858    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517862    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517866    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517871    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517875    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517879    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517883    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517887    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517891    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517894    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.584658 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517898    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517902    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517909    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517914    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517919    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517924    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517929    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517932    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517936    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517940    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517943    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517947    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517951    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517955    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517959    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517963    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517966    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517972    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517977    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.824591 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517991    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.589321 ip-10-0-129-17 systemd[1]: Started Kubernetes Kubelet.
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.517996    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518000    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518005    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518009    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518013    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518018    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518021    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518025    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518029    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518034    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518037    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518041    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518045    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518049    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518053    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518057    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518062    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518065    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518070    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.830831 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518074    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518078    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518082    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518085    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518090    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518094    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518097    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518102    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518105    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518108    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518112    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518115    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518118    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518121    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518124    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518127    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518131    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518134    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518137    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.831587 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518140    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.518143    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521509    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521518    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521522    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521525    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521528    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521532    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521535    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521539    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521543    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521546    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521548    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521552    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521556    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521558    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521561    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521564    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521566    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521568    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.832311 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521571    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521574    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521577    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521579    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521583    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521586    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521588    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521605    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521609    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521612    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521616    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521619    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521621    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521624    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521627    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521629    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521632    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521636    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521639    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.832930 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521642    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521645    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521648    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521651    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521653    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521656    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521658    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521661    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521664    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521667    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521670    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521672    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521675    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521677    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521680    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521683    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521686    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521688    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521691    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521694    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.833561 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521696    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521699    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521720    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521723    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521726    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521729    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521732    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521735    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521737    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521742    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521745    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521748    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521752    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521755    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521757    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521760    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521764    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521767    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521770    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.834144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521773    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521776    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521779    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521782    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521784    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521787    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521789    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521792    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521794    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521798    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521800    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521803    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521806    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521809    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521812    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521815    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521817    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521820    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521823    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521825    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.834759 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521828    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521831    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.521833    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522577    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522589    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522594    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522598    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522603    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522608    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522612    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522617    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522622    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522626    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522632    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522636    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522646    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522650    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522654    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522658    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522662    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.835328 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522667    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522673    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522677    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522682    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522686    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522690    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522694    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522717    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522726    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522731    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522735    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522739    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522743    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522747    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522754    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522761    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522769    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522774    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522779    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.835939 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522783    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522792    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522797    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522801    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522806    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522810    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522814    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522819    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522823    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522828    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522832    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522836    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522840    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522849    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522855    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522859    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522863    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522868    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522872    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522878    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.836523 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522882    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522886    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522893    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522897    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522901    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522909    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522913    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522916    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522919    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522921    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522924    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522927    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522929    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522932    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522935    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522937    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522940    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.522974    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523006    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523013    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.837167 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523073    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523591    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523612    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523621    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523624    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523627    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523630    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523633    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523636    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523639    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523643    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523647    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523649    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523652    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523655    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523657    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523660    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523663    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523667    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.837761 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523671    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523675    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523677    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.523680    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523790    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523800    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523810    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523816    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523822    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523827    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523836    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523843    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523848    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523852    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523858    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523862    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523867    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523871    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523875    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523879    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523884    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523888    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523895    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523899    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 01:28:07.838330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523904    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523909    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523914    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523919    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523922    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523927    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523931    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523935    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523940    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523944    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523948    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523953    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523959    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523963    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523967    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523971    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523975    2572 flags.go:64] FLAG: --enable-server="true"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523980    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523988    2572 flags.go:64] FLAG: --event-burst="100"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523993    2572 flags.go:64] FLAG: --event-qps="50"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.523997    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524002    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524006    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524011    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 01:28:07.839007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524016    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524020    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524025    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524029    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524033    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524037    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524043    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524047    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524051    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524055    2572 flags.go:64] FLAG: --feature-gates=""
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524061    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524065    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524069    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524074    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524078    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524082    2572 flags.go:64] FLAG: --help="false"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524087    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524092    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524096    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524100    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524105    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524111    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524116    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 01:28:07.839750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524119    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524124    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524128    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524133    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524138    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524143    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524146    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524151    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524155    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524159    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524163    2572 flags.go:64] FLAG: --lock-file=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524167    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524171    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524175    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524182    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524188    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524202    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524207    2572 flags.go:64] FLAG: --logging-format="text"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524211    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524216    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524220    2572 flags.go:64] FLAG: --manifest-url=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524224    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524230    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524234    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524240    2572 flags.go:64] FLAG: --max-pods="110"
Jul 23 01:28:07.840567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524244    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524248    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524252    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524257    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524261    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524265    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524270    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524293    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524298    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524303    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524309    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524314    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524321    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524325    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524329    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524334    2572 flags.go:64] FLAG: --port="10250"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524338    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524342    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-075650f8a22804bf0"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524347    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524350    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524354    2572 flags.go:64] FLAG: --register-node="true"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524359    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524364    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524369    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 23 01:28:07.841666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524382    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524386    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524392    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524396    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524401    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524405    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524409    2572 flags.go:64] FLAG: --runonce="false"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524412    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524417    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524422    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524426    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524430    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524434    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524438    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524443    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524447    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524452    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524455    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524461    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524465    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524469    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524473    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524481    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524485    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524490    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 01:28:07.842987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524496    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524500    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524504    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524508    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524513    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524517    2572 flags.go:64] FLAG: --v="2"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524523    2572 flags.go:64] FLAG: --version="false"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524529    2572 flags.go:64] FLAG: --vmodule=""
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524543    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.524549    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524720    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524726    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524731    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524737    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524742    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524746    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524750    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524755    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524759    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524763    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524768    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524771    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.844109 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524774    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524776    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524779    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524783    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524785    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524788    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524790    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524793    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524796    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524798    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524800    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524803    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524805    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524808    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524810    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524813    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524819    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524822    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524825    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.847144 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524837    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524843    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524848    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524852    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524856    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524860    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524863    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524868    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524872    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524875    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524880    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524883    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524887    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524891    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524894    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524898    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524904    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524908    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524912    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524916    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.848016 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524919    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524923    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524927    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524931    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524934    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524938    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524941    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524945    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524949    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524954    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524958    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524962    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524966    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524978    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524982    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524986    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524991    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.524996    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525000    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525005    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.972560 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525010    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525014    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525017    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525021    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525025    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525028    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525032    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525037    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525043    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525046    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525049    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525053    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525057    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525060    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525064    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525068    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525072    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525075    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525080    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525083    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.973636 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525087    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525092    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525096    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525099    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525103    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525107    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525118    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.525122    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.525899    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.533449    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.533578    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.533597    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.533603    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533655    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533660    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.974494 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533663    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533666    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533670    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533672    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533675    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533678    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533681    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533683    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533686    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533688    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533691    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533694    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533697    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533722    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533726    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533728    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533731    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533734    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533737    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533740    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.975349 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533742    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533745    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533749    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533753    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533756    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533758    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533761    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533765    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533768    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533770    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533775    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533778    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533781    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533783    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533786    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533789    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533791    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533794    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533797    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533799    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.976228 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533802    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533805    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533808    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533812    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533815    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533818    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533821    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533824    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533826    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533830    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533834    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533837    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533840    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533843    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533846    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533851    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533854    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533857    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533860    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.977100 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533862    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533866    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533869    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533873    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533876    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533878    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533881    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533883    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533886    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533888    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533891    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533894    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533896    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533898    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533901    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533903    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533906    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533909    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533912    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.977973 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533914    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533917    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533919    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533922    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533924    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533927    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533929    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533932    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533934    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533938    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533941    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533943    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533946    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533948    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533951    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533954    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533958    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533960    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.978844 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.533963    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.533968    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534075    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534080    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534083    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534086    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534089    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534091    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534094    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534097    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534100    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534102    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534105    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534108    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 01:28:07.979746 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534110    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534113    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534115    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534118    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534120    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534123    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534125    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534128    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534130    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534132    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534136    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534139    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534141    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534144    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534147    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534149    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534154    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534157    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534161    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534164    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 01:28:07.980380 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534167    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534170    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534172    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534175    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534177    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534180    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534182    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534185    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534187    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534190    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534192    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534195    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534197    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534200    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534202    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534205    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534208    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534210    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534213    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534216    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 01:28:07.981261 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534218    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534220    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534224    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534227    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534230    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534232    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534235    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534237    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534241    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534245    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534247    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534250    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534252    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534255    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534258    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534260    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534263    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534265    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534268    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534270    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 01:28:07.982163 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534273    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534275    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534277    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534280    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534282    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534285    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534287    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534291    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534294    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534298    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534300    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534303    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534305    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534308    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534312    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534315    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534317    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534319    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534322    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534324    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 01:28:07.983068 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534328    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534331    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534341    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534344    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534346    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534349    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:07.534352    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.534356    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.534457    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.536800    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.538418    2572 server.go:1019] "Starting client certificate rotation"
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.538518    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.538547    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 01:28:07.983963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.542749    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.544569    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.552930    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.555970    2572 log.go:25] "Validated CRI v1 image API"
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.556737    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.559401    2572 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 aa111287-9103-4b4a-8fc1-aca5fdab7dc4:/dev/nvme0n1p4 e13c208e-57a6-4a94-9bb3-694c046903a0:/dev/nvme0n1p3]
Jul 23 01:28:07.984629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.559414    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.565933    2572 manager.go:216] Machine: {Timestamp:2026-07-23 01:28:07.564553823 +0000 UTC m=+0.376345342 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100916 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f14aa51e57722b9351241b2ca1d11 SystemUUID:ec2f14aa-51e5-7722-b935-1241b2ca1d11 BootID:e92f894d-c9ff-4c23-8393-fff8fdb0aeb1 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:83:34:40:42:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:83:34:40:42:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:bb:b8:54:41:0a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.566027    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.566127    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.569516    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.569545    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-17.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.571105    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.571134    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.571146    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.571153    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.571814    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.573482    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.577820    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.577940    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.577973    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.577984    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.577998    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 01:28:07.985290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.578007    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.578016    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.578295    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.578309    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.580639    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.582927    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.582957    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584352    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584366    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584374    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584381    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584398    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584404    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584413    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584418    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584425    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584430    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584443    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.584448    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.585464    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.585474    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.588576    2572 server.go:1268] "Started kubelet"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.588635    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.589265    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.589326    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.594114    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.594476    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.594530    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.594799    2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-17.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.596493    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.597396    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.600347    2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-17.ec2.internal.18c4c6f04475565e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-17.ec2.internal,UID:ip-10-0-129-17.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-17.ec2.internal,},FirstTimestamp:2026-07-23 01:28:07.588550238 +0000 UTC m=+0.400341759,LastTimestamp:2026-07-23 01:28:07.588550238 +0000 UTC m=+0.400341759,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-17.ec2.internal,}"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605086    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605101    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.605158    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605805    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605816    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605831    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605836    2572 factory.go:55] Registering systemd factory
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605874    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605923    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 01:28:07.986173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.605933    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606108    2572 factory.go:153] Registering CRI-O factory
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606123    2572 factory.go:223] Registration of the crio container factory successfully
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606167    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606185    2572 factory.go:103] Registering Raw factory
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606195    2572 manager.go:1196] Started watching for new ooms in manager
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.606525    2572 manager.go:349] Starting recovery of all containers
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.606809    2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.606893    2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-17.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.614354    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvrf6"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.619321    2572 manager.go:354] Recovery completed
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.621827    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nvrf6"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.627205    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629328    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629361    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629375    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629948    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629961    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629967    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.629979    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.630620    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.630645    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.630659    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.631089    2572 policy_none.go:49] "None policy: Start"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.631103    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.631117    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.632125    2572 policy_none.go:47] "Start"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676074    2572 manager.go:337] "Starting Device Plugin manager"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.676104    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676114    2572 server.go:87] "Starting device plugin registration server"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676345    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676356    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676447    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676529    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.676539    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.677092    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.677150    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.678541    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.679658    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.679695    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.679732    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.679768    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.681745    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.776730    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.777500    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.777527    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.987944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.777537    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.777557    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.780626    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"]
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.780671    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.781309    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.781334    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.781345    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.782546    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.782651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.782682    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783206    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783227    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783242    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783246    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783262    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.783274    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.784433    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.784462    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.785133    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.785169    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.785184    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeHasSufficientPID"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.786107    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.786123    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-17.ec2.internal\": node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.811595    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.817489    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-17.ec2.internal\" not found" node="ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.822179    2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-17.ec2.internal\" not found" node="ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.907250    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad3ec310531404ccf6f92f1adf8fbff-config\") pod \"kube-apiserver-proxy-ip-10-0-129-17.ec2.internal\" (UID: \"dad3ec310531404ccf6f92f1adf8fbff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.907270    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:07.907287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:07.989933 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:07.911920    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad3ec310531404ccf6f92f1adf8fbff-config\") pod \"kube-apiserver-proxy-ip-10-0-129-17.ec2.internal\" (UID: \"dad3ec310531404ccf6f92f1adf8fbff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008410    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dad3ec310531404ccf6f92f1adf8fbff-config\") pod \"kube-apiserver-proxy-ip-10-0-129-17.ec2.internal\" (UID: \"dad3ec310531404ccf6f92f1adf8fbff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008427    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008444    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008477    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.008518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7da4cc6d926d1fa40d08da5f3a2d026d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal\" (UID: \"7da4cc6d926d1fa40d08da5f3a2d026d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.066962 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.012475    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.193759 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.113265    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.193759 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.122428    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.193759 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.126613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:08.336980 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.213443    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.336980 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.314184    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.462855 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.414749    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.462855 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.435103    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:08.590461 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.515206    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:08.590461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.537360    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 01:28:08.590461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.537469    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 01:28:08.590461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:08.537510    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 01:28:09.784734 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:08.615438    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:09.784734 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:09.693099    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 01:23:08 +0000 UTC" deadline="2028-04-23 17:45:27.046363526 +0000 UTC"
Jul 23 01:28:09.784734 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:09.693121    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15376h17m17.353244925s"
Jul 23 01:28:09.784734 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:09.778716    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:09.894819 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:09.798773    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad3ec310531404ccf6f92f1adf8fbff.slice/crio-71e84251ce89efcae94ae04d026538c6892a9b9be4a3a2eb10f4f5fd48bebccb WatchSource:0}: Error finding container 71e84251ce89efcae94ae04d026538c6892a9b9be4a3a2eb10f4f5fd48bebccb: Status 404 returned error can't find the container with id 71e84251ce89efcae94ae04d026538c6892a9b9be4a3a2eb10f4f5fd48bebccb
Jul 23 01:28:09.894819 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:09.799012    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da4cc6d926d1fa40d08da5f3a2d026d.slice/crio-b3c0d071eb2e636b882c48ab0df0fa5b7a38f536e592bd8734f3f44404555352 WatchSource:0}: Error finding container b3c0d071eb2e636b882c48ab0df0fa5b7a38f536e592bd8734f3f44404555352: Status 404 returned error can't find the container with id b3c0d071eb2e636b882c48ab0df0fa5b7a38f536e592bd8734f3f44404555352
Jul 23 01:28:09.894819 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:09.803977    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 01:28:09.894819 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:09.879526    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:10.028932 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:09.979966    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:10.107520 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.080345    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-17.ec2.internal\" not found"
Jul 23 01:28:10.180404 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.174117    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:10.281808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.257630    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:10.281808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.268415    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:10.281808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.276340    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 01:28:10.281808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.277569    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal"
Jul 23 01:28:10.287400 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.287385    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 01:28:10.642522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.642424    2572 apiserver.go:52] "Watching apiserver"
Jul 23 01:28:10.649444 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.649416    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 01:28:10.650632 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.650602    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-mjtnk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal","openshift-multus/multus-additional-cni-plugins-dlzwg","openshift-multus/multus-ndbjh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d","openshift-image-registry/node-ca-bxp7v","openshift-multus/network-metrics-daemon-cfrth","openshift-network-diagnostics/network-check-target-9qw2g","openshift-network-operator/iptables-alerter-rftff","openshift-ovn-kubernetes/ovnkube-node-mcfzv","kube-system/global-pull-secret-syncer-dllpf","kube-system/konnectivity-agent-5t4tc","kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal","openshift-cluster-node-tuning-operator/tuned-6wlgr"]
Jul 23 01:28:10.652406 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.652386    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.654508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.654487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.655479    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.655700    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.655837    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.655922    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.656086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.656096    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhn5g\""
Jul 23 01:28:10.656268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.656174    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 01:28:10.656673 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.656320    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.657122 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.656918    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bbv27\""
Jul 23 01:28:10.657122 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.657043    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.658307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.657329    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.658307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.658127    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.658881 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.658861    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 01:28:10.659298 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.659280    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 01:28:10.660131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.659495    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sfsxb\""
Jul 23 01:28:10.660131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.659709    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.660604 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.660584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.660694 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.660670    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ch6k7\""
Jul 23 01:28:10.661310 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.660878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.661310 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.660928    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.661877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.661828    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.662339 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.662178    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-46kww\""
Jul 23 01:28:10.662339 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.662334    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 01:28:10.662680 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.662623    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.662766 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.662707    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.662766 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.662712    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:10.663062 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663022    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 01:28:10.663468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663147    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.663468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663240    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.663468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663261    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 01:28:10.663468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663402    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zskbn\""
Jul 23 01:28:10.663703 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.663630    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:10.663750 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.663702    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:10.665095 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.665076    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.667011 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.666985    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.668686 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.668666    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6gjdg\""
Jul 23 01:28:10.669042 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.669025    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.669107 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.669060    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.669886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.669855    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 01:28:10.670215 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.670199    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 01:28:10.671362 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.671344    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 01:28:10.671873 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.671852    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pfn6r\""
Jul 23 01:28:10.672394 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.672371    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 01:28:10.675090 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.675068    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.675218 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.675195    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:10.676177 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.676150    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 01:28:10.676499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.676479    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.678924 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.678906    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 01:28:10.679014 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.678947    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2btv7\""
Jul 23 01:28:10.679258 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679241    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 01:28:10.679664 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baddff25-c286-4cec-ad32-4c9ff83a2dba-hosts-file\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.679729 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679680    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-netns\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.679729 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-multus\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.679789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-kubelet\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.679789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679750    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.679789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tmcc\" (UniqueName: \"kubernetes.io/projected/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-kube-api-access-6tmcc\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.679908 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-cni-binary-copy\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.679908 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679826    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-k8s-cni-cncf-io\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.679908 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-multus-certs\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.679908 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679896    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp2fh\" (UniqueName: \"kubernetes.io/projected/b9783d7b-260d-457a-8597-77a2a80d9a2e-kube-api-access-hp2fh\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.680022 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.680022 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679941    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.680022 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.679963    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-config\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680103 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680028    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6t7r\" (UniqueName: \"kubernetes.io/projected/baddff25-c286-4cec-ad32-4c9ff83a2dba-kube-api-access-j6t7r\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.680103 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680052    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-etc-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680103 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-netd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:10.680226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680144    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-conf-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.680226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680167    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-slash\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680463 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4770b03e-179a-4468-b3b9-cd2466e2a664-serviceca\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.680508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680481    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25a86810-7c0b-4d65-aa87-7e6346a85818-konnectivity-ca\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.680553 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-bin\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680591 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.680623 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680623 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680613    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-env-overrides\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.680683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680640    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baddff25-c286-4cec-ad32-4c9ff83a2dba-tmp-dir\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.680737 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.680715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-modprobe-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-cnibin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.681491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.681491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681479    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-systemd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.681557 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-log-socket\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.681557 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjg8\" (UniqueName: \"kubernetes.io/projected/6582ec18-38e5-4f54-8720-85ef9715cd26-kube-api-access-qqjg8\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.681622 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681544    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4770b03e-179a-4468-b3b9-cd2466e2a664-host\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.681622 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-iptables-alerter-script\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.681713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681627    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-dbus\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.681713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6582ec18-38e5-4f54-8720-85ef9715cd26-ovn-node-metrics-cert\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.681713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681678    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysconfig\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-systemd\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-lib-modules\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681742    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-tuned\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wndcz\" (UniqueName: \"kubernetes.io/projected/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-kube-api-access-wndcz\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-kubelet\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-hostroot\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.681849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-daemon-config\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681854    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-systemd-units\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681886    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-ovn\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-var-lib-kubelet\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjffv\" (UniqueName: \"kubernetes.io/projected/8e3962fb-66de-43fa-b837-57ece6d1d56c-kube-api-access-cjffv\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681954    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-sys\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt4tw\" (UniqueName: \"kubernetes.io/projected/4770b03e-179a-4468-b3b9-cd2466e2a664-kube-api-access-lt4tw\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.682029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.681996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-os-release\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.682379 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.682356    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sznsf\" (UniqueName: \"kubernetes.io/projected/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kube-api-access-sznsf\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.682865 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.682842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-netns\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.682946 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.682927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-node-log\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.683013 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.682962    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-host-slash\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.683159 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683101    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-run\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683219 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683199    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-host\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.683271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683255    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-socket-dir-parent\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.683363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683278    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-bin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.683363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-etc-kubernetes\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.683363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.683363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683345    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-kubernetes\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683391    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-var-lib-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683413    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-script-lib\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683476    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-tmp\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683521    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-device-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683545    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25a86810-7c0b-4d65-aa87-7e6346a85818-agent-certs\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.683612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.683980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-conf\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.683980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683646    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-system-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.684076 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.683989    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-kubelet-config\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.689169 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.689148    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 01:28:10.715131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.715109    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmgwr"
Jul 23 01:28:10.724317 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.724297    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmgwr"
Jul 23 01:28:10.746905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.746869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal" event={"ID":"7da4cc6d926d1fa40d08da5f3a2d026d","Type":"ContainerStarted","Data":"b3c0d071eb2e636b882c48ab0df0fa5b7a38f536e592bd8734f3f44404555352"}
Jul 23 01:28:10.748094 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.748070    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal" event={"ID":"dad3ec310531404ccf6f92f1adf8fbff","Type":"ContainerStarted","Data":"71e84251ce89efcae94ae04d026538c6892a9b9be4a3a2eb10f4f5fd48bebccb"}
Jul 23 01:28:10.769707 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.769687    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 01:28:10.784426 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-slash\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4770b03e-179a-4468-b3b9-cd2466e2a664-serviceca\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.784547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25a86810-7c0b-4d65-aa87-7e6346a85818-konnectivity-ca\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.784547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-bin\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784548    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-slash\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784575    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.784675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784805 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-bin\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784805 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784747    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-env-overrides\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784805 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.784766    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:10.784805 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784779    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baddff25-c286-4cec-ad32-4c9ff83a2dba-tmp-dir\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.784805 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784786    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.784954 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-modprobe-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.784954 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-cnibin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.784954 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784883    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.785046 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.784965    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:11.284921184 +0000 UTC m=+3.033980847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:10.785046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.784975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-registration-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.785046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785012    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-systemd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785055    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-log-socket\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4770b03e-179a-4468-b3b9-cd2466e2a664-serviceca\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.785147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785081    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjg8\" (UniqueName: \"kubernetes.io/projected/6582ec18-38e5-4f54-8720-85ef9715cd26-kube-api-access-qqjg8\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785109    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4770b03e-179a-4468-b3b9-cd2466e2a664-host\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.785147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785136    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-iptables-alerter-script\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-dbus\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785190    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6582ec18-38e5-4f54-8720-85ef9715cd26-ovn-node-metrics-cert\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysconfig\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785227    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/25a86810-7c0b-4d65-aa87-7e6346a85818-konnectivity-ca\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-modprobe-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-systemd\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-env-overrides\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-lib-modules\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785304 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-systemd\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785296    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-cnibin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785303    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-tuned\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wndcz\" (UniqueName: \"kubernetes.io/projected/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-kube-api-access-wndcz\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-systemd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4770b03e-179a-4468-b3b9-cd2466e2a664-host\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-kubelet\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-hostroot\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-kubelet\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785304    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/baddff25-c286-4cec-ad32-4c9ff83a2dba-tmp-dir\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785490    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-daemon-config\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-hostroot\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-systemd-units\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785568    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-ovn\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785576    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysconfig\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-var-lib-kubelet\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-systemd-units\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-log-socket\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785682    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-var-lib-kubelet\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785624    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjffv\" (UniqueName: \"kubernetes.io/projected/8e3962fb-66de-43fa-b837-57ece6d1d56c-kube-api-access-cjffv\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-sys\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt4tw\" (UniqueName: \"kubernetes.io/projected/4770b03e-179a-4468-b3b9-cd2466e2a664-kube-api-access-lt4tw\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-os-release\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785882    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sznsf\" (UniqueName: \"kubernetes.io/projected/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kube-api-access-sznsf\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785906    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-netns\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785904    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-node-log\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.785950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-host-slash\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-run\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.785980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-host\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786000    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786066    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-dbus\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-socket-dir-parent\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786110    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-iptables-alerter-script\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-daemon-config\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-bin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786216    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-etc-kubernetes\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786233    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-run\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786242    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-run-netns\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-lib-modules\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786360    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-node-log\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786372    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-kubernetes\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-bin\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.786681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786414    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-host-slash\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786494    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-etc-kubernetes\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-sys\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-kubernetes\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-os-release\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786449    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-host\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.786184    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-ovn\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-var-lib-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.787615 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-socket-dir-parent\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.788015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787667    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-script-lib\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.788015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-run-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.788015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.787932    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.788165 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-etc-selinux\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.788165 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.788415 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.788384    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:10.788644 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-script-lib\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.788725 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.788671    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:11.28865334 +0000 UTC m=+3.037713008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:10.788798 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788727    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-tmp\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.788873 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-d\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.788873 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788797    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.788873 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788860    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-var-lib-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.789033 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-device-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.789033 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.788984    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25a86810-7c0b-4d65-aa87-7e6346a85818-agent-certs\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.789033 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-os-release\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.789207 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789035    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-device-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.789207 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789055    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.789311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789215    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.789311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789257    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-conf\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.789450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789292    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-system-cni-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.789450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789363    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-cnibin\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.789450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-system-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-kubelet-config\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789538    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baddff25-c286-4cec-ad32-4c9ff83a2dba-hosts-file\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789564    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-netns\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789605    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-multus\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789636    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-kubelet\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tmcc\" (UniqueName: \"kubernetes.io/projected/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-kube-api-access-6tmcc\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-cni-binary-copy\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789802    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-k8s-cni-cncf-io\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-system-cni-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789855    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-multus-certs\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp2fh\" (UniqueName: \"kubernetes.io/projected/b9783d7b-260d-457a-8597-77a2a80d9a2e-kube-api-access-hp2fh\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.789934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789920    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-multus-certs\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.790322 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789946    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.790322 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789979    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.790322 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.789988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-kubelet-config\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:10.790322 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790066    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/baddff25-c286-4cec-ad32-4c9ff83a2dba-hosts-file\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790573    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-netns\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-kubelet\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790735    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-config\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-sys-fs\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790800    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-run-k8s-cni-cncf-io\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6t7r\" (UniqueName: \"kubernetes.io/projected/baddff25-c286-4cec-ad32-4c9ff83a2dba-kube-api-access-j6t7r\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-etc-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790902    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-sysctl-conf\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790946    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-etc-tuned\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.790945    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-netd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791038    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-socket-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-etc-openvswitch\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6hq6\" (UniqueName: \"kubernetes.io/projected/48cb9123-c805-44cf-a0f0-1dd46158c078-kube-api-access-w6hq6\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-cni-netd\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791147    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-host-var-lib-cni-multus\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.791393 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791018    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6582ec18-38e5-4f54-8720-85ef9715cd26-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-conf-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-tmp\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791324    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b9783d7b-260d-457a-8597-77a2a80d9a2e-multus-conf-dir\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791690    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6582ec18-38e5-4f54-8720-85ef9715cd26-ovnkube-config\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791778    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.792265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.791924    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6582ec18-38e5-4f54-8720-85ef9715cd26-ovn-node-metrics-cert\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.794278 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.794256    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b9783d7b-260d-457a-8597-77a2a80d9a2e-cni-binary-copy\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.795818 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.795764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/25a86810-7c0b-4d65-aa87-7e6346a85818-agent-certs\") pod \"konnectivity-agent-5t4tc\" (UID: \"25a86810-7c0b-4d65-aa87-7e6346a85818\") " pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.797457 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.797418    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wndcz\" (UniqueName: \"kubernetes.io/projected/a746e9be-d1a1-41e5-81e6-847cdaefd4bd-kube-api-access-wndcz\") pod \"tuned-6wlgr\" (UID: \"a746e9be-d1a1-41e5-81e6-847cdaefd4bd\") " pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.797698 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.797681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjg8\" (UniqueName: \"kubernetes.io/projected/6582ec18-38e5-4f54-8720-85ef9715cd26-kube-api-access-qqjg8\") pod \"ovnkube-node-mcfzv\" (UID: \"6582ec18-38e5-4f54-8720-85ef9715cd26\") " pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.797790 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.797704    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:10.797790 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.797685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sznsf\" (UniqueName: \"kubernetes.io/projected/805ecb90-9b5b-4cf7-b410-f37cac13fa01-kube-api-access-sznsf\") pod \"aws-ebs-csi-driver-node-xbm9d\" (UID: \"805ecb90-9b5b-4cf7-b410-f37cac13fa01\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:10.802944 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.802898    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:10.803069 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.803055    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:10.803296 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.803273    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt4tw\" (UniqueName: \"kubernetes.io/projected/4770b03e-179a-4468-b3b9-cd2466e2a664-kube-api-access-lt4tw\") pod \"node-ca-bxp7v\" (UID: \"4770b03e-179a-4468-b3b9-cd2466e2a664\") " pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:10.803386 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.803374    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:10.803556 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:10.803540    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:11.303517927 +0000 UTC m=+3.052577601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:10.804062 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.803951    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjffv\" (UniqueName: \"kubernetes.io/projected/8e3962fb-66de-43fa-b837-57ece6d1d56c-kube-api-access-cjffv\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:10.804264 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.804224    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tmcc\" (UniqueName: \"kubernetes.io/projected/6e8fb4b6-1764-4aa6-8f94-822171e4f19c-kube-api-access-6tmcc\") pod \"iptables-alerter-rftff\" (UID: \"6e8fb4b6-1764-4aa6-8f94-822171e4f19c\") " pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:10.804545 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.804518    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp2fh\" (UniqueName: \"kubernetes.io/projected/b9783d7b-260d-457a-8597-77a2a80d9a2e-kube-api-access-hp2fh\") pod \"multus-ndbjh\" (UID: \"b9783d7b-260d-457a-8597-77a2a80d9a2e\") " pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:10.805271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.805244    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6t7r\" (UniqueName: \"kubernetes.io/projected/baddff25-c286-4cec-ad32-4c9ff83a2dba-kube-api-access-j6t7r\") pod \"node-resolver-mjtnk\" (UID: \"baddff25-c286-4cec-ad32-4c9ff83a2dba\") " pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:10.891809 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891841    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-os-release\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-system-cni-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-cnibin\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.891997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.891965    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892003    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-os-release\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6hq6\" (UniqueName: \"kubernetes.io/projected/48cb9123-c805-44cf-a0f0-1dd46158c078-kube-api-access-w6hq6\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-system-cni-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892109    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892122    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/48cb9123-c805-44cf-a0f0-1dd46158c078-cnibin\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892486    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-binary-copy\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.892563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.892559    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/48cb9123-c805-44cf-a0f0-1dd46158c078-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.904148 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.904123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6hq6\" (UniqueName: \"kubernetes.io/projected/48cb9123-c805-44cf-a0f0-1dd46158c078-kube-api-access-w6hq6\") pod \"multus-additional-cni-plugins-dlzwg\" (UID: \"48cb9123-c805-44cf-a0f0-1dd46158c078\") " pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:10.973325 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.973292    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:10.977331 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.977306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6wlgr"
Jul 23 01:28:10.990974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.990953    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:10.998544 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:10.998525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjtnk"
Jul 23 01:28:11.005356 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.005338    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ndbjh"
Jul 23 01:28:11.013202 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.013180    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bxp7v"
Jul 23 01:28:11.023928 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.023909    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rftff"
Jul 23 01:28:11.029745 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.029729    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d"
Jul 23 01:28:11.036259 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.036239    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dlzwg"
Jul 23 01:28:11.293883 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.293799    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:11.293883 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.293867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:11.294106 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.293964    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:11.294106 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.293989    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:11.294106 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.294040    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:12.294020372 +0000 UTC m=+4.043080030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:11.294106 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.294063    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:12.294049842 +0000 UTC m=+4.043109498 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:11.394856 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.394819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:11.395036 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.394948    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:11.395036 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.394971    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:11.395036 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.394981    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:11.395171 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:11.395044    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:12.395028776 +0000 UTC m=+4.144088441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:11.706799 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.706689    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda746e9be_d1a1_41e5_81e6_847cdaefd4bd.slice/crio-bfce447c481e33d2aa50fc742efc6e245ee78835133d3efceaba3927c6c46d64 WatchSource:0}: Error finding container bfce447c481e33d2aa50fc742efc6e245ee78835133d3efceaba3927c6c46d64: Status 404 returned error can't find the container with id bfce447c481e33d2aa50fc742efc6e245ee78835133d3efceaba3927c6c46d64
Jul 23 01:28:11.708982 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.708953    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4770b03e_179a_4468_b3b9_cd2466e2a664.slice/crio-7035790b1d56c46f318e3a145b95ce3aaf52e86b5f70a292c4b41f8480df56c5 WatchSource:0}: Error finding container 7035790b1d56c46f318e3a145b95ce3aaf52e86b5f70a292c4b41f8480df56c5: Status 404 returned error can't find the container with id 7035790b1d56c46f318e3a145b95ce3aaf52e86b5f70a292c4b41f8480df56c5
Jul 23 01:28:11.710345 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.710226    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8fb4b6_1764_4aa6_8f94_822171e4f19c.slice/crio-7c8f1f83ffd8badde7b90d02758989ae8bde0d336f37fff10030c46f4dc385f3 WatchSource:0}: Error finding container 7c8f1f83ffd8badde7b90d02758989ae8bde0d336f37fff10030c46f4dc385f3: Status 404 returned error can't find the container with id 7c8f1f83ffd8badde7b90d02758989ae8bde0d336f37fff10030c46f4dc385f3
Jul 23 01:28:11.711736 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.711695    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9783d7b_260d_457a_8597_77a2a80d9a2e.slice/crio-fb15f6d5486305d4b8e5d16bd5e2b49dac3fa773f5c1de6ca9d212d31d9d828e WatchSource:0}: Error finding container fb15f6d5486305d4b8e5d16bd5e2b49dac3fa773f5c1de6ca9d212d31d9d828e: Status 404 returned error can't find the container with id fb15f6d5486305d4b8e5d16bd5e2b49dac3fa773f5c1de6ca9d212d31d9d828e
Jul 23 01:28:11.712724 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.712599    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaddff25_c286_4cec_ad32_4c9ff83a2dba.slice/crio-aec505a7e521f43147fc1b1265fd8567fe46e3629f9d5e09136c6d2c705e0a14 WatchSource:0}: Error finding container aec505a7e521f43147fc1b1265fd8567fe46e3629f9d5e09136c6d2c705e0a14: Status 404 returned error can't find the container with id aec505a7e521f43147fc1b1265fd8567fe46e3629f9d5e09136c6d2c705e0a14
Jul 23 01:28:11.713629 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:11.713341    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a86810_7c0b_4d65_aa87_7e6346a85818.slice/crio-3826d48bc5a643205354259b5ab49dad8af2faa0b4aadeb365fc26b1d5c4bc3f WatchSource:0}: Error finding container 3826d48bc5a643205354259b5ab49dad8af2faa0b4aadeb365fc26b1d5c4bc3f: Status 404 returned error can't find the container with id 3826d48bc5a643205354259b5ab49dad8af2faa0b4aadeb365fc26b1d5c4bc3f
Jul 23 01:28:11.726872 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.726824    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 01:23:10 +0000 UTC" deadline="2028-05-02 16:37:45.96846846 +0000 UTC"
Jul 23 01:28:11.726872 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.726872    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15591h9m34.241600318s"
Jul 23 01:28:11.754450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.754411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"c2c294eb180e85f8b67510cfc7b6f384d022391c4d8ba0248b44f28c46658f0c"}
Jul 23 01:28:11.755975 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.755950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d" event={"ID":"805ecb90-9b5b-4cf7-b410-f37cac13fa01","Type":"ContainerStarted","Data":"6b0c2b47006ca3c6372fb33c94f28a8b149cdc7b071f1dbfaee4ec3a016385f6"}
Jul 23 01:28:11.756949 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.756925    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t4tc" event={"ID":"25a86810-7c0b-4d65-aa87-7e6346a85818","Type":"ContainerStarted","Data":"3826d48bc5a643205354259b5ab49dad8af2faa0b4aadeb365fc26b1d5c4bc3f"}
Jul 23 01:28:11.757903 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.757881    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rftff" event={"ID":"6e8fb4b6-1764-4aa6-8f94-822171e4f19c","Type":"ContainerStarted","Data":"7c8f1f83ffd8badde7b90d02758989ae8bde0d336f37fff10030c46f4dc385f3"}
Jul 23 01:28:11.758746 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.758725    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxp7v" event={"ID":"4770b03e-179a-4468-b3b9-cd2466e2a664","Type":"ContainerStarted","Data":"7035790b1d56c46f318e3a145b95ce3aaf52e86b5f70a292c4b41f8480df56c5"}
Jul 23 01:28:11.759475 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.759456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjtnk" event={"ID":"baddff25-c286-4cec-ad32-4c9ff83a2dba","Type":"ContainerStarted","Data":"aec505a7e521f43147fc1b1265fd8567fe46e3629f9d5e09136c6d2c705e0a14"}
Jul 23 01:28:11.760359 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.760340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerStarted","Data":"d4cd02898b697f3f9c2fdeffd36b6085887166fed7d90280bd0769eee1027ac1"}
Jul 23 01:28:11.766665 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.766645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ndbjh" event={"ID":"b9783d7b-260d-457a-8597-77a2a80d9a2e","Type":"ContainerStarted","Data":"fb15f6d5486305d4b8e5d16bd5e2b49dac3fa773f5c1de6ca9d212d31d9d828e"}
Jul 23 01:28:11.768922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:11.768897    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6wlgr" event={"ID":"a746e9be-d1a1-41e5-81e6-847cdaefd4bd","Type":"ContainerStarted","Data":"bfce447c481e33d2aa50fc742efc6e245ee78835133d3efceaba3927c6c46d64"}
Jul 23 01:28:12.300690 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.300610    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:12.300690 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.300686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:12.300893 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.300801    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:12.300893 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.300861    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:14.30084285 +0000 UTC m=+6.049902514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:12.301007 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.300924    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:12.301007 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.300959    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:14.300948643 +0000 UTC m=+6.050008298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:12.401971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.401350    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:12.401971 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.401541    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:12.401971 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.401564    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:12.401971 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.401576    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:12.401971 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.401641    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:14.401622756 +0000 UTC m=+6.150682422 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:12.508411 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.508171    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 01:28:12.727487 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.727387    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 01:23:10 +0000 UTC" deadline="2028-01-07 00:20:17.06575609 +0000 UTC"
Jul 23 01:28:12.727487 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.727428    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12790h52m4.338332406s"
Jul 23 01:28:12.743831 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.743807    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:12.743973 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.743943    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:12.744091 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.744026    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:12.744161 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.744095    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:12.744161 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.744150    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:12.744255 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:12.744215    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:12.793167 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.792050    2572 generic.go:356] "Generic (PLEG): container finished" podID="7da4cc6d926d1fa40d08da5f3a2d026d" containerID="5934d8db9e37a3380fc41b214a7be9f8cd88483583ad7339152956d777dd1b80" exitCode=0
Jul 23 01:28:12.793167 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.792137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal" event={"ID":"7da4cc6d926d1fa40d08da5f3a2d026d","Type":"ContainerDied","Data":"5934d8db9e37a3380fc41b214a7be9f8cd88483583ad7339152956d777dd1b80"}
Jul 23 01:28:12.806167 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:12.805903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal" event={"ID":"dad3ec310531404ccf6f92f1adf8fbff","Type":"ContainerStarted","Data":"ac0e35b2336a0db7c3533361df160ec85022ca2d1cf1506c9652481567eb5f4d"}
Jul 23 01:28:13.822126 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:13.822003    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal" event={"ID":"7da4cc6d926d1fa40d08da5f3a2d026d","Type":"ContainerStarted","Data":"e5cc3dcbf51581a1cfc5305c31ab1b5f446dcc8dfc445ac44e10e068c834a4c1"}
Jul 23 01:28:13.839135 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:13.837460    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-17.ec2.internal" podStartSLOduration=3.837426766 podStartE2EDuration="3.837426766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:12.830980665 +0000 UTC m=+4.580040339" watchObservedRunningTime="2026-07-23 01:28:13.837426766 +0000 UTC m=+5.586486439"
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.317692    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.317770    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.317899    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.317960    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:18.317941636 +0000 UTC m=+10.067001287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.318356    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:14.318499 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.318406    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:18.318391875 +0000 UTC m=+10.067451541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:14.418948 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.418898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:14.419135 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.419082    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:14.419135 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.419105    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:14.419135 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.419117    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:14.419290 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.419172    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:18.419155213 +0000 UTC m=+10.168214878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.743494    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.743638    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.744014    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.744096    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:14.744154    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:14.744501 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:14.744228    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:16.742878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:16.742755    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:16.742878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:16.742788    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:16.743386 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:16.742888    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:16.743386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:16.743137    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:16.743386 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:16.743251    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:16.743386 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:16.743348    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:18.352186 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.352083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:18.352186 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.352174    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:18.352720 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.352223    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:18.352720 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.352276    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:18.352720 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.352301    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:26.35227893 +0000 UTC m=+18.101338598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:18.352720 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.352330    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:26.352312676 +0000 UTC m=+18.101372341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:18.453317 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.453263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:18.453524 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.453445    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:18.453524 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.453470    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:18.453524 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.453482    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:18.453676 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.453540    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:26.453521279 +0000 UTC m=+18.202580943 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.743639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.743731    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.743875    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.744012    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:18.744076    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:18.744465 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:18.744181    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:20.743491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:20.743461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:20.743491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:20.743452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:20.743995 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:20.743583    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:20.743995 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:20.743620    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:20.743995 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:20.743719    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:20.743995 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:20.743825    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:22.742857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:22.742827    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:22.742857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:22.742845    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:22.743372 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:22.742981    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:22.743372 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:22.743041    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:22.743372 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:22.743044    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:22.743372 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:22.743125    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:24.743631 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:24.743596    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:24.744113 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:24.743595    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:24.744113 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:24.743729    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:24.744113 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:24.743726    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:24.744113 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:24.743849    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:24.744113 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:24.743954    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:26.413178 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.413150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:26.413651 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.413195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:26.413651 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.413327    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:26.413651 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.413363    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:26.413651 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.413399    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:42.41337726 +0000 UTC m=+34.162436928 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:26.413651 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.413466    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:28:42.413454683 +0000 UTC m=+34.162514338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:26.514429 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.514394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:26.514613 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.514548    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:26.514613 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.514572    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:26.514613 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.514585    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:26.514742 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.514637    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:42.514619139 +0000 UTC m=+34.263678802 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:26.743272 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.743193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:26.743425 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.743193    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:26.743425 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.743315    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:26.743553 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.743421    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:26.743553 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:26.743202    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:26.743553 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:26.743533    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:28.743365 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:28.743336    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:28.743758 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:28.743403    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:28.743758 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:28.743423    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:28.743758 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:28.743501    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:28.743758 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:28.743545    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:28.743758 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:28.743598    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:30.743992 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.743711    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:30.744616 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.743716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:30.744616 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:30.744067    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:30.744616 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.743743    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:30.744616 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:30.744136    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:30.744616 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:30.744251    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:30.856414 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.856390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bxp7v" event={"ID":"4770b03e-179a-4468-b3b9-cd2466e2a664","Type":"ContainerStarted","Data":"303074029c9b01f4ec7a0e3067be6e12add561802e52239dd61727dccae01420"}
Jul 23 01:28:30.857625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.857602    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjtnk" event={"ID":"baddff25-c286-4cec-ad32-4c9ff83a2dba","Type":"ContainerStarted","Data":"cd7e8a4a6bf85bde813636c3eb188d9b5b565bad44f2962900f7f62a608baad0"}
Jul 23 01:28:30.859050 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.859027    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="4648ce52b7c3150934b72f7db0620c0fd3c066241620d6e15a3d698e599127aa" exitCode=0
Jul 23 01:28:30.859144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.859108    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"4648ce52b7c3150934b72f7db0620c0fd3c066241620d6e15a3d698e599127aa"}
Jul 23 01:28:30.860668 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.860650    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ndbjh" event={"ID":"b9783d7b-260d-457a-8597-77a2a80d9a2e","Type":"ContainerStarted","Data":"c4d3d4282452b203c6d844b23b1b801779397abb86e2a796f5fd7dcbbbfbaa9a"}
Jul 23 01:28:30.862057 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.861999    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6wlgr" event={"ID":"a746e9be-d1a1-41e5-81e6-847cdaefd4bd","Type":"ContainerStarted","Data":"4389b33a90811bbac6003cce8b00b2d5b194c2552d5c22b9fd8983c97d30d9c5"}
Jul 23 01:28:30.864987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.864965    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"1ae0fa9609c3da38af5a6923592a666e3db75e3dff93df9c58a63903ddb6d6c3"}
Jul 23 01:28:30.865086 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.865027    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"18ef21e1419497dad3a8b55f6a2557c7783eefadbe9e9a44d84c755f51c86a0d"}
Jul 23 01:28:30.865086 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.865069    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"5fccc56d047b3ee484dc4133b37a6c603ffa6c6a44658260e5de9c675754f219"}
Jul 23 01:28:30.865191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.865115    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"c9ac48c71bcfe9394fe1828619d6db50b924d2b1c6e539a4c008d8c4b7968a24"}
Jul 23 01:28:30.866806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.866787    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d" event={"ID":"805ecb90-9b5b-4cf7-b410-f37cac13fa01","Type":"ContainerStarted","Data":"586f939bc070b40cc32c256dbc0f2ea81bbd61ea9a043360e3e5fafa88029479"}
Jul 23 01:28:30.868156 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.868136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5t4tc" event={"ID":"25a86810-7c0b-4d65-aa87-7e6346a85818","Type":"ContainerStarted","Data":"9523ec2c77dae15d9e97bf80218c09daaf50510a1459aa939c3d924ec85844cb"}
Jul 23 01:28:30.869929 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.869887    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-17.ec2.internal" podStartSLOduration=20.869875791 podStartE2EDuration="20.869875791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:13.83905122 +0000 UTC m=+5.588110892" watchObservedRunningTime="2026-07-23 01:28:30.869875791 +0000 UTC m=+22.618935462"
Jul 23 01:28:30.870237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.870209    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bxp7v" podStartSLOduration=3.269324384 podStartE2EDuration="21.870199268s" totalImagesPullingTime="18.600874884s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:30.869327559 +0000 UTC m=+22.618387231" watchObservedRunningTime="2026-07-23 01:28:30.870199268 +0000 UTC m=+22.619258955"
Jul 23 01:28:30.884945 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.884909    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6wlgr" podStartSLOduration=4.264953861 podStartE2EDuration="22.884897457s" totalImagesPullingTime="18.619943596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:30.884874357 +0000 UTC m=+22.633934029" watchObservedRunningTime="2026-07-23 01:28:30.884897457 +0000 UTC m=+22.633957128"
Jul 23 01:28:30.902037 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.900198    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5t4tc" podStartSLOduration=8.714293918 podStartE2EDuration="22.900179421s" totalImagesPullingTime="14.185885503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:30.899394057 +0000 UTC m=+22.648453731" watchObservedRunningTime="2026-07-23 01:28:30.900179421 +0000 UTC m=+22.649239095"
Jul 23 01:28:30.920795 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.920762    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjtnk" podStartSLOduration=4.33065743 podStartE2EDuration="22.920749353s" totalImagesPullingTime="18.590091923s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:30.920748537 +0000 UTC m=+22.669808208" watchObservedRunningTime="2026-07-23 01:28:30.920749353 +0000 UTC m=+22.669809025"
Jul 23 01:28:30.943552 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:30.943502    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ndbjh" podStartSLOduration=3.288383982 podStartE2EDuration="21.943483915s" totalImagesPullingTime="18.655099933s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:30.942671541 +0000 UTC m=+22.691731213" watchObservedRunningTime="2026-07-23 01:28:30.943483915 +0000 UTC m=+22.692543588"
Jul 23 01:28:31.756947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.756921    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 01:28:31.874154 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.874119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"fc74f5892d5561321a9e438f45046aa50123feba70ab949668c1022e4c03dc3d"}
Jul 23 01:28:31.874408 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.874222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"794da1f4967071c97c03e03be8563c23c8a45229b84ac6b0ed7c0a9e889bd679"}
Jul 23 01:28:31.876655 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.876595    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d" event={"ID":"805ecb90-9b5b-4cf7-b410-f37cac13fa01","Type":"ContainerStarted","Data":"b4e6fa009333a7dbc84558b3563a968076f54519e52852da2b125c0b00ecc245"}
Jul 23 01:28:31.878147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.878100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rftff" event={"ID":"6e8fb4b6-1764-4aa6-8f94-822171e4f19c","Type":"ContainerStarted","Data":"147c89b93660544619a1991ad9d2f9c58392b5e871a057f380afd14aba42f00a"}
Jul 23 01:28:31.892398 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:31.892351    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rftff" podStartSLOduration=4.30205858 podStartE2EDuration="22.892333575s" totalImagesPullingTime="18.590274995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:31.89224148 +0000 UTC m=+23.641301153" watchObservedRunningTime="2026-07-23 01:28:31.892333575 +0000 UTC m=+23.641393248"
Jul 23 01:28:32.743165 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.743131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:32.743535 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:32.743267    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:32.743535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.743310    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:32.743535 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:32.743419    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:32.743535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.743469    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:32.743843 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:32.743539    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:32.751728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.751639    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T01:28:31.756943497Z","UUID":"8809ff82-53f9-4fcc-ab3f-9ba0bd450f77","Handler":null,"Name":"","Endpoint":""}
Jul 23 01:28:32.753523 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.753492    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 01:28:32.753617 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:32.753551    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 01:28:33.887015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:33.886973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"f88c61df0f8af11a109d064527e52fe2924fddfcf369c141d4a7a475d283d1af"}
Jul 23 01:28:33.889169 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:33.889140    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d" event={"ID":"805ecb90-9b5b-4cf7-b410-f37cac13fa01","Type":"ContainerStarted","Data":"9bbda7f6770c23a51265ddac7ec30c451f03ea48870f67a3fb8e319312b3908b"}
Jul 23 01:28:33.907245 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:33.907194    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xbm9d" podStartSLOduration=3.823856797 podStartE2EDuration="24.907175199s" totalImagesPullingTime="21.083318402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:33.906199375 +0000 UTC m=+25.655259061" watchObservedRunningTime="2026-07-23 01:28:33.907175199 +0000 UTC m=+25.656234870"
Jul 23 01:28:33.937408 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:33.937382    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:33.937998 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:33.937978    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:34.743089 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:34.742838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:34.743280 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:34.742838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:34.743280 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:34.742892    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:34.743280 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:34.743204    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:34.743455 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:34.743292    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:34.743455 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:34.743379    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:34.892282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:34.892244    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:34.892756 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:34.892580    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5t4tc"
Jul 23 01:28:35.895681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:35.895646    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="28ecce29bb749843b517294a2d077cab29a8905851a6ed3c02895e2cbf523759" exitCode=0
Jul 23 01:28:35.896466 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:35.895737    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"28ecce29bb749843b517294a2d077cab29a8905851a6ed3c02895e2cbf523759"}
Jul 23 01:28:35.899474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:35.899448    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" event={"ID":"6582ec18-38e5-4f54-8720-85ef9715cd26","Type":"ContainerStarted","Data":"e65ff8a1e7e1e99feccd065fc652d8bc641ea66faf1e4192e5cc04a956fe7126"}
Jul 23 01:28:35.938737 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:35.938691    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv" podStartSLOduration=9.284564673 podStartE2EDuration="27.938675698s" totalImagesPullingTime="18.654111025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:35.938499571 +0000 UTC m=+27.687559241" watchObservedRunningTime="2026-07-23 01:28:35.938675698 +0000 UTC m=+27.687735364"
Jul 23 01:28:36.743162 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.743130    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:36.743468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.743131    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:36.743468 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:36.743229    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:36.743468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.743247    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:36.743468 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:36.743345    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:36.743624 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:36.743514    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:36.902458 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.902400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:36.902815 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.902509    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:36.902815 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.902560    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:36.916310 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.916289    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:36.916759 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:36.916738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:28:37.307995 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.307967    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dllpf"]
Jul 23 01:28:37.308125 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.308114    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:37.308224 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:37.308206    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:37.311320 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.311287    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9qw2g"]
Jul 23 01:28:37.311487 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.311386    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:37.311612 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:37.311516    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:37.311878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.311855    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfrth"]
Jul 23 01:28:37.311980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.311964    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:37.312068 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:37.312053    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:37.905625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.905593    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="7e87eec6f2d6e682b167c7e34019a0a8db6947c8b414713803e0ef92dd97fa11" exitCode=0
Jul 23 01:28:37.906123 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:37.905672    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"7e87eec6f2d6e682b167c7e34019a0a8db6947c8b414713803e0ef92dd97fa11"}
Jul 23 01:28:38.744066 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:38.743876    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:38.744242 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:38.743942    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:38.744242 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:38.744153    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:38.744242 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:38.744221    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:39.742977 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:39.742906    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:39.743357 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:39.743033    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:39.912554 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:39.912518    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="179ab6aad14fb9aa029efad43d16ee4b08c89701036bcfe17b173e67db009cbd" exitCode=0
Jul 23 01:28:39.912719 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:39.912608    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"179ab6aad14fb9aa029efad43d16ee4b08c89701036bcfe17b173e67db009cbd"}
Jul 23 01:28:40.743117 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:40.743085    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:40.743735 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:40.743085    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:40.743735 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:40.743194    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:40.743735 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:40.743262    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:41.743631 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:41.743558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:41.744052 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:41.743719    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cfrth" podUID="8e3962fb-66de-43fa-b837-57ece6d1d56c"
Jul 23 01:28:42.432819 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:42.432789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:42.432976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:42.432848    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:42.432976 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.432928    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:42.432976 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.432929    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:42.432976 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.432976    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret podName:a69a7473-d4c3-47a4-9d48-4bbb63fb889e nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.432962945 +0000 UTC m=+66.182022595 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret") pod "global-pull-secret-syncer-dllpf" (UID: "a69a7473-d4c3-47a4-9d48-4bbb63fb889e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 01:28:42.433112 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.432988    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs podName:8e3962fb-66de-43fa-b837-57ece6d1d56c nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.432982252 +0000 UTC m=+66.182041902 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs") pod "network-metrics-daemon-cfrth" (UID: "8e3962fb-66de-43fa-b837-57ece6d1d56c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 01:28:42.534038 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:42.533991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:42.534214 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.534196    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 01:28:42.534271 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.534221    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 01:28:42.534271 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.534231    2572 projected.go:196] Error preparing data for projected volume kube-api-access-zkct4 for pod openshift-network-diagnostics/network-check-target-9qw2g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:42.534354 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.534281    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4 podName:d5d49c25-0706-4670-9ea3-47ec15b5e6c8 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.53426316 +0000 UTC m=+66.283322830 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zkct4" (UniqueName: "kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4") pod "network-check-target-9qw2g" (UID: "d5d49c25-0706-4670-9ea3-47ec15b5e6c8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 01:28:42.743008 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:42.742940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:42.743161 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.743059    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9qw2g" podUID="d5d49c25-0706-4670-9ea3-47ec15b5e6c8"
Jul 23 01:28:42.743161 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:42.743124    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:42.743283 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:42.743242    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dllpf" podUID="a69a7473-d4c3-47a4-9d48-4bbb63fb889e"
Jul 23 01:28:43.027967 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.027884    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-17.ec2.internal" event="NodeReady"
Jul 23 01:28:43.028537 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.028040    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 01:28:43.060336 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.060308    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"]
Jul 23 01:28:43.062734 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.062713    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.065282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.065257    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:28:43.066761 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.066740    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 01:28:43.066850 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.066778    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.066850 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.066803    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.066955 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.066807    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 01:28:43.067077 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.067056    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"]
Jul 23 01:28:43.067191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.067088    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qtqqz\""
Jul 23 01:28:43.067191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.067170    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.068824 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.068808    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"
Jul 23 01:28:43.069741 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.069485    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6src\""
Jul 23 01:28:43.069741 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.069501    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 01:28:43.069741 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.069513    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 01:28:43.070303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.070287    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 01:28:43.071952 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.071253    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.071952 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.071898    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.072072 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.071973    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2tkvq\""
Jul 23 01:28:43.076492 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.076046    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"]
Jul 23 01:28:43.078043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.078025    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 01:28:43.078144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.078067    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"]
Jul 23 01:28:43.078472 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.078336    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.079757 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.079741    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2qmm2"]
Jul 23 01:28:43.079877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.079862    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.080627 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.080609    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.081214 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.080630    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lcbz2\""
Jul 23 01:28:43.081214 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.080793    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.081363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.080853    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 01:28:43.081664 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.081645    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"]
Jul 23 01:28:43.081809 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.081767    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.082011 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.081989    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 01:28:43.082880 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.082507    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 01:28:43.082880 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.082732    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 01:28:43.083234 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.083214    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.083485 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.083467    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.083573 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.083500    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:28:43.083663 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.083582    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dm58r\""
Jul 23 01:28:43.085275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.085213    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 01:28:43.085275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.085215    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.085513 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.085424    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6hl5r\""
Jul 23 01:28:43.085915 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.085698    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 01:28:43.085915 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.085804    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.086639 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.086488    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"]
Jul 23 01:28:43.090523 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.090394    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"]
Jul 23 01:28:43.096233 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.094170    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 01:28:43.100556 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.100459    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5d624"]
Jul 23 01:28:43.102824 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.102791    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-l2zcp"]
Jul 23 01:28:43.102946 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.102926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.104886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.104870    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"]
Jul 23 01:28:43.105140 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.105014    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.105630 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.105610    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 01:28:43.106014 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.105994    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 01:28:43.106177 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.106160    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjsgq\""
Jul 23 01:28:43.107676 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.107657    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9jz9j"]
Jul 23 01:28:43.107792 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.107777    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.107896 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.107876    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 01:28:43.108077 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.108060    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.108318 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.108299    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 01:28:43.108892 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.108875    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.109015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.108991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-fg6kn\""
Jul 23 01:28:43.109905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.109883    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"]
Jul 23 01:28:43.110104 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.110088    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.112359 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.112337    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-855fd99b4-5vxfg"]
Jul 23 01:28:43.112903 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.112887    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"
Jul 23 01:28:43.114269 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.114252    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"]
Jul 23 01:28:43.114269 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.114283    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5d624"]
Jul 23 01:28:43.114269 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.114307    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9jz9j"]
Jul 23 01:28:43.114576 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.114382    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.116525 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.116507    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2qmm2"]
Jul 23 01:28:43.118052 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.118032    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.119283 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.119266    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.119849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.119424    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 01:28:43.119849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.119741    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.120097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120068    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.120177 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120119    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.120177 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120148    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.120280 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120251    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ctqv7\""
Jul 23 01:28:43.120370 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120357    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cl24z\""
Jul 23 01:28:43.120457 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120418    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 01:28:43.120521 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120508    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"]
Jul 23 01:28:43.120969 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.120954    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-l2zcp"]
Jul 23 01:28:43.121924 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.121902    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-855fd99b4-5vxfg"]
Jul 23 01:28:43.123199 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.123169    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 01:28:43.123629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.123607    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gdrbc\""
Jul 23 01:28:43.123845 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.123831    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 01:28:43.123921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.123893    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 01:28:43.124186 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.124167    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 01:28:43.124408 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.124388    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 01:28:43.124524 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.124506    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 01:28:43.124599 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.124570    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8b4vz\""
Jul 23 01:28:43.130733 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.130710    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 01:28:43.137379 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.137360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"]
Jul 23 01:28:43.138391 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138361    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138397    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138635 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138635 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138544    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sllqv\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138635 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138571    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138635 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138607    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmql5\" (UniqueName: \"kubernetes.io/projected/960736d3-2bff-4ee9-94c2-0e6600842f0e-kube-api-access-xmql5\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.138917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.138917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138709    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8lg8\" (UniqueName: \"kubernetes.io/projected/6fd6d7af-60b7-469b-8c62-bd0baa77077b-kube-api-access-j8lg8\") pod \"volume-data-source-validator-78cf4c6f6-fjvxl\" (UID: \"6fd6d7af-60b7-469b-8c62-bd0baa77077b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"
Jul 23 01:28:43.138917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/960736d3-2bff-4ee9-94c2-0e6600842f0e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.138917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.138749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960736d3-2bff-4ee9-94c2-0e6600842f0e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.239404 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239370    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-stats-auth\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.239594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239420    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.239594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-config\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.239594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prn5g\" (UniqueName: \"kubernetes.io/projected/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-kube-api-access-prn5g\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.239594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d74qn\" (UniqueName: \"kubernetes.io/projected/03749fcc-052e-460d-95e1-33b3f0a2633e-kube-api-access-d74qn\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.239594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239576    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-snapshots\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp464\" (UniqueName: \"kubernetes.io/projected/7fb4982d-5610-4864-900a-bf65fc33709c-kube-api-access-kp464\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/960736d3-2bff-4ee9-94c2-0e6600842f0e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239688    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-tmp\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960736d3-2bff-4ee9-94c2-0e6600842f0e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239776    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9c9p\" (UniqueName: \"kubernetes.io/projected/9795fa52-04c5-454b-80aa-ee5d416b9a87-kube-api-access-b9c9p\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.239825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239806    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdsxt\" (UniqueName: \"kubernetes.io/projected/cd59b648-0a9e-4fcd-a87e-d581a9945b02-kube-api-access-hdsxt\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239902    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239968    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sllqv\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.239992    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-config-volume\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240019    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9795fa52-04c5-454b-80aa-ee5d416b9a87-cert\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47e0cccc-44ce-4404-926a-586e3295e4aa-serving-cert\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.240097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240098    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbd4n\" (UniqueName: \"kubernetes.io/projected/d57d900d-6389-4547-b053-f843db29723c-kube-api-access-mbd4n\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240130    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03749fcc-052e-460d-95e1-33b3f0a2633e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240154    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-trusted-ca\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmql5\" (UniqueName: \"kubernetes.io/projected/960736d3-2bff-4ee9-94c2-0e6600842f0e-kube-api-access-xmql5\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h7k\" (UniqueName: \"kubernetes.io/projected/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-kube-api-access-28h7k\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240299    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/960736d3-2bff-4ee9-94c2-0e6600842f0e-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240337    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240375    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240393    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8lg8\" (UniqueName: \"kubernetes.io/projected/6fd6d7af-60b7-469b-8c62-bd0baa77077b-kube-api-access-j8lg8\") pod \"volume-data-source-validator-78cf4c6f6-fjvxl\" (UID: \"6fd6d7af-60b7-469b-8c62-bd0baa77077b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.240405    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-tmp-dir\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.240420    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.240535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.240525    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.740501066 +0000 UTC m=+35.489560723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58vn\" (UniqueName: \"kubernetes.io/projected/47e0cccc-44ce-4404-926a-586e3295e4aa-kube-api-access-q58vn\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240572    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-default-certificate\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240600    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-service-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240624    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fnrg\" (UniqueName: \"kubernetes.io/projected/e15d75ef-4a21-42a8-be94-2f354a6ab704-kube-api-access-9fnrg\") pod \"network-check-source-7bc5b6bf85-q9lh5\" (UID: \"e15d75ef-4a21-42a8-be94-2f354a6ab704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240701    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fb4982d-5610-4864-900a-bf65fc33709c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240731    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240967    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.240964    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03749fcc-052e-460d-95e1-33b3f0a2633e-config\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.241268 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.241004    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-serving-cert\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.244841 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.244816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/960736d3-2bff-4ee9-94c2-0e6600842f0e-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.245245 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.245212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.245498 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.245478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.249020 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.248997    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.249909 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.249876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8lg8\" (UniqueName: \"kubernetes.io/projected/6fd6d7af-60b7-469b-8c62-bd0baa77077b-kube-api-access-j8lg8\") pod \"volume-data-source-validator-78cf4c6f6-fjvxl\" (UID: \"6fd6d7af-60b7-469b-8c62-bd0baa77077b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"
Jul 23 01:28:43.250000 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.249954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sllqv\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.250636 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.250593    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmql5\" (UniqueName: \"kubernetes.io/projected/960736d3-2bff-4ee9-94c2-0e6600842f0e-kube-api-access-xmql5\") pod \"kube-storage-version-migrator-operator-7658d9b749-5f6qj\" (UID: \"960736d3-2bff-4ee9-94c2-0e6600842f0e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.342215 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342140    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9795fa52-04c5-454b-80aa-ee5d416b9a87-cert\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.342215 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342179    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47e0cccc-44ce-4404-926a-586e3295e4aa-serving-cert\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.342215 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342196    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbd4n\" (UniqueName: \"kubernetes.io/projected/d57d900d-6389-4547-b053-f843db29723c-kube-api-access-mbd4n\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.342476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342220    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03749fcc-052e-460d-95e1-33b3f0a2633e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.342476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342244    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-trusted-ca\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.342476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342345    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.342476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342412    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.342476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342458    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h7k\" (UniqueName: \"kubernetes.io/projected/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-kube-api-access-28h7k\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342501    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-tmp-dir\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.342546    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58vn\" (UniqueName: \"kubernetes.io/projected/47e0cccc-44ce-4404-926a-586e3295e4aa-kube-api-access-q58vn\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342583    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-default-certificate\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.342610    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.842588863 +0000 UTC m=+35.591648523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342641    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-service-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fnrg\" (UniqueName: \"kubernetes.io/projected/e15d75ef-4a21-42a8-be94-2f354a6ab704-kube-api-access-9fnrg\") pod \"network-check-source-7bc5b6bf85-q9lh5\" (UID: \"e15d75ef-4a21-42a8-be94-2f354a6ab704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"
Jul 23 01:28:43.342728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342722    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fb4982d-5610-4864-900a-bf65fc33709c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03749fcc-052e-460d-95e1-33b3f0a2633e-config\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-serving-cert\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-stats-auth\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342892    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-config\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prn5g\" (UniqueName: \"kubernetes.io/projected/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-kube-api-access-prn5g\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d74qn\" (UniqueName: \"kubernetes.io/projected/03749fcc-052e-460d-95e1-33b3f0a2633e-kube-api-access-d74qn\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342947    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-tmp-dir\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.342980    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-snapshots\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.343103    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.843087189 +0000 UTC m=+35.592146872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343207    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-trusted-ca\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp464\" (UniqueName: \"kubernetes.io/projected/7fb4982d-5610-4864-900a-bf65fc33709c-kube-api-access-kp464\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343301    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-tmp\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9c9p\" (UniqueName: \"kubernetes.io/projected/9795fa52-04c5-454b-80aa-ee5d416b9a87-kube-api-access-b9c9p\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.343410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdsxt\" (UniqueName: \"kubernetes.io/projected/cd59b648-0a9e-4fcd-a87e-d581a9945b02-kube-api-access-hdsxt\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343417    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-config-volume\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03749fcc-052e-460d-95e1-33b3f0a2633e-config\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7fb4982d-5610-4864-900a-bf65fc33709c-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.343874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-service-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.344123    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-config-volume\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.344483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.344388    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-tmp\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.344888 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.344493    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:43.344888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.344536    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/47e0cccc-44ce-4404-926a-586e3295e4aa-config\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.344888 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.344591    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.844538443 +0000 UTC m=+35.593598099 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:43.345043 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.345008    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:43.345093 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.345067    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.845052725 +0000 UTC m=+35.594112379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:43.345170 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.345151    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:43.345228 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.345183    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-snapshots\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.345228 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.345216    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:43.845201073 +0000 UTC m=+35.594260728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:43.345405 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.345381    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.346078 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.345976    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03749fcc-052e-460d-95e1-33b3f0a2633e-serving-cert\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.346078 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.345994    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9795fa52-04c5-454b-80aa-ee5d416b9a87-cert\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.346234 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.346193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/47e0cccc-44ce-4404-926a-586e3295e4aa-serving-cert\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.346234 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.346205    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-serving-cert\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.347273 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.347251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-stats-auth\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.348005 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.347984    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-default-certificate\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.350640 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.350621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h7k\" (UniqueName: \"kubernetes.io/projected/6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11-kube-api-access-28h7k\") pod \"insights-operator-555d9d7885-l2zcp\" (UID: \"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11\") " pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.350788 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.350764    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbd4n\" (UniqueName: \"kubernetes.io/projected/d57d900d-6389-4547-b053-f843db29723c-kube-api-access-mbd4n\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.353536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.353466    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fnrg\" (UniqueName: \"kubernetes.io/projected/e15d75ef-4a21-42a8-be94-2f354a6ab704-kube-api-access-9fnrg\") pod \"network-check-source-7bc5b6bf85-q9lh5\" (UID: \"e15d75ef-4a21-42a8-be94-2f354a6ab704\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"
Jul 23 01:28:43.355821 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.355781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp464\" (UniqueName: \"kubernetes.io/projected/7fb4982d-5610-4864-900a-bf65fc33709c-kube-api-access-kp464\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.355913 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.355867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d74qn\" (UniqueName: \"kubernetes.io/projected/03749fcc-052e-460d-95e1-33b3f0a2633e-kube-api-access-d74qn\") pod \"service-ca-operator-5bcbc94c78-5gwmj\" (UID: \"03749fcc-052e-460d-95e1-33b3f0a2633e\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.355913 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.355898    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9c9p\" (UniqueName: \"kubernetes.io/projected/9795fa52-04c5-454b-80aa-ee5d416b9a87-kube-api-access-b9c9p\") pod \"ingress-canary-9jz9j\" (UID: \"9795fa52-04c5-454b-80aa-ee5d416b9a87\") " pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.356172 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.356144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdsxt\" (UniqueName: \"kubernetes.io/projected/cd59b648-0a9e-4fcd-a87e-d581a9945b02-kube-api-access-hdsxt\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.356302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.356280    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58vn\" (UniqueName: \"kubernetes.io/projected/47e0cccc-44ce-4404-926a-586e3295e4aa-kube-api-access-q58vn\") pod \"console-operator-565b7b569d-2qmm2\" (UID: \"47e0cccc-44ce-4404-926a-586e3295e4aa\") " pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.357179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.357157    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prn5g\" (UniqueName: \"kubernetes.io/projected/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-kube-api-access-prn5g\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.376852 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.376832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"
Jul 23 01:28:43.400147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.400118    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"
Jul 23 01:28:43.417045 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.417021    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"
Jul 23 01:28:43.425722 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.425693    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:43.439453 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.439412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-l2zcp"
Jul 23 01:28:43.453180 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.453163    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9jz9j"
Jul 23 01:28:43.459777 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.459760    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"
Jul 23 01:28:43.742901 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.742823    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:28:43.745508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.745475    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 01:28:43.745508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.745492    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-frx6l\""
Jul 23 01:28:43.747623 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.747598    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:43.747769 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.747695    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:43.747769 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.747714    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:43.747769 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.747768    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.747748871 +0000 UTC m=+36.496808534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:43.848348 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.848318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.848375    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.848415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848458    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848509    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848517    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.848498937 +0000 UTC m=+36.597558604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:43.848539 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848543    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.848531818 +0000 UTC m=+36.597591468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848557    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.848550146 +0000 UTC m=+36.597609797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.848582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:43.848613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848700    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848716    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848732    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.848721801 +0000 UTC m=+36.597781451 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:43.848845 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:43.848768    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:44.84875399 +0000 UTC m=+36.597813640 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:44.461621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.461305    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-2qmm2"]
Jul 23 01:28:44.471965 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:44.471887    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47e0cccc_44ce_4404_926a_586e3295e4aa.slice/crio-28cca24f3223b22f5d525c36445c4aa7ad3336454b50b07b398643795899ad32 WatchSource:0}: Error finding container 28cca24f3223b22f5d525c36445c4aa7ad3336454b50b07b398643795899ad32: Status 404 returned error can't find the container with id 28cca24f3223b22f5d525c36445c4aa7ad3336454b50b07b398643795899ad32
Jul 23 01:28:44.492757 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.492585    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5"]
Jul 23 01:28:44.492757 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.492698    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9jz9j"]
Jul 23 01:28:44.493513 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.493476    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl"]
Jul 23 01:28:44.496232 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:44.496181    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode15d75ef_4a21_42a8_be94_2f354a6ab704.slice/crio-669eb28258697fa03a3a615f87daa41875ef5112a42f364dff51a57389686d14 WatchSource:0}: Error finding container 669eb28258697fa03a3a615f87daa41875ef5112a42f364dff51a57389686d14: Status 404 returned error can't find the container with id 669eb28258697fa03a3a615f87daa41875ef5112a42f364dff51a57389686d14
Jul 23 01:28:44.507303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.505470    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj"]
Jul 23 01:28:44.511173 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:44.511147    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03749fcc_052e_460d_95e1_33b3f0a2633e.slice/crio-bbf45dc53ee493a320c2d6f2060692a83ef891b67ce02ac5446b99e6f90144ce WatchSource:0}: Error finding container bbf45dc53ee493a320c2d6f2060692a83ef891b67ce02ac5446b99e6f90144ce: Status 404 returned error can't find the container with id bbf45dc53ee493a320c2d6f2060692a83ef891b67ce02ac5446b99e6f90144ce
Jul 23 01:28:44.517112 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.517090    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-l2zcp"]
Jul 23 01:28:44.518000 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.517979    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj"]
Jul 23 01:28:44.522138 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:44.521922    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod960736d3_2bff_4ee9_94c2_0e6600842f0e.slice/crio-57529962eb5cb15bd52639a85b2451ab2ed75f0428a0b6f4d82979874cfe0f4b WatchSource:0}: Error finding container 57529962eb5cb15bd52639a85b2451ab2ed75f0428a0b6f4d82979874cfe0f4b: Status 404 returned error can't find the container with id 57529962eb5cb15bd52639a85b2451ab2ed75f0428a0b6f4d82979874cfe0f4b
Jul 23 01:28:44.522403 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:28:44.522383    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a81b7cc_dd4d_4ac7_837f_a1c586c0ed11.slice/crio-f2ab609e46bb09a0963fc9268f3e3607d4807e63fcd4cd3b4dd5607358e6eac2 WatchSource:0}: Error finding container f2ab609e46bb09a0963fc9268f3e3607d4807e63fcd4cd3b4dd5607358e6eac2: Status 404 returned error can't find the container with id f2ab609e46bb09a0963fc9268f3e3607d4807e63fcd4cd3b4dd5607358e6eac2
Jul 23 01:28:44.743909 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.743635    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:28:44.744046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.743680    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:28:44.746610 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.746593    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lg5p2\""
Jul 23 01:28:44.746720 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.746628    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 01:28:44.758235 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.758219    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:44.758376 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.758364    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:44.758450 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.758378    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:44.758450 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.758422    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.758409055 +0000 UTC m=+38.507468721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:44.859468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.859424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:44.859572 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.859484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:44.859630 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859584    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.859568445 +0000 UTC m=+38.608628100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:44.859630 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859583    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:44.859630 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859611    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.859605357 +0000 UTC m=+38.608665008 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:44.859630 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.859611    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:44.859827 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.859675    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:44.859827 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.859708    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:44.859827 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859765    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:44.859827 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859780    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:44.859827 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859813    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.859797926 +0000 UTC m=+38.608857593 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:44.860005 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859833    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.859820458 +0000 UTC m=+38.608880122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:44.860005 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859849    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:44.860005 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:44.859906    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:46.859888062 +0000 UTC m=+38.608947713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:44.925448 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.925411    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj" event={"ID":"960736d3-2bff-4ee9-94c2-0e6600842f0e","Type":"ContainerStarted","Data":"57529962eb5cb15bd52639a85b2451ab2ed75f0428a0b6f4d82979874cfe0f4b"}
Jul 23 01:28:44.926728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.926703    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-l2zcp" event={"ID":"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11","Type":"ContainerStarted","Data":"f2ab609e46bb09a0963fc9268f3e3607d4807e63fcd4cd3b4dd5607358e6eac2"}
Jul 23 01:28:44.927994 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.927968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" event={"ID":"47e0cccc-44ce-4404-926a-586e3295e4aa","Type":"ContainerStarted","Data":"28cca24f3223b22f5d525c36445c4aa7ad3336454b50b07b398643795899ad32"}
Jul 23 01:28:44.931367 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.931344    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="6e2bcc1f68166909bc0ef49fce8c7c3463c0303829e5a9bbb62342e38ae88e50" exitCode=0
Jul 23 01:28:44.931489 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.931447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"6e2bcc1f68166909bc0ef49fce8c7c3463c0303829e5a9bbb62342e38ae88e50"}
Jul 23 01:28:44.932898 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.932864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5" event={"ID":"e15d75ef-4a21-42a8-be94-2f354a6ab704","Type":"ContainerStarted","Data":"669eb28258697fa03a3a615f87daa41875ef5112a42f364dff51a57389686d14"}
Jul 23 01:28:44.934151 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.934128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9jz9j" event={"ID":"9795fa52-04c5-454b-80aa-ee5d416b9a87","Type":"ContainerStarted","Data":"2b4abf92ddc6119b2a4870341aa0872879cb2c8f5d7ce3dfd8a69b77d4be9db6"}
Jul 23 01:28:44.935383 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.935350    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj" event={"ID":"03749fcc-052e-460d-95e1-33b3f0a2633e","Type":"ContainerStarted","Data":"bbf45dc53ee493a320c2d6f2060692a83ef891b67ce02ac5446b99e6f90144ce"}
Jul 23 01:28:44.936706 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:44.936683    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl" event={"ID":"6fd6d7af-60b7-469b-8c62-bd0baa77077b","Type":"ContainerStarted","Data":"7a866ea730ed2d9e500da6da49573c5827d04d6389f2bfe697ec2a66c4643032"}
Jul 23 01:28:45.957274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:45.956328    2572 generic.go:356] "Generic (PLEG): container finished" podID="48cb9123-c805-44cf-a0f0-1dd46158c078" containerID="f3f8db2a395437e559b4a8c16672fb0a9440442c98c36ccb16db27b3ef8b9db8" exitCode=0
Jul 23 01:28:45.957274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:45.956395    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerDied","Data":"f3f8db2a395437e559b4a8c16672fb0a9440442c98c36ccb16db27b3ef8b9db8"}
Jul 23 01:28:46.781567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.781491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:46.781765 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.781672    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:46.781765 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.781691    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:46.781885 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.781777    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.781755404 +0000 UTC m=+42.530815079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.882887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.882954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.882994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.883106    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.883154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883306    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.883286173 +0000 UTC m=+42.632345830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883548    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883594    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.883580938 +0000 UTC m=+42.632640599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883649    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883696    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.883668863 +0000 UTC m=+42.632728517 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883751    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883781    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.883771214 +0000 UTC m=+42.632830870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883832    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:46.883914 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:46.883859    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:50.883849568 +0000 UTC m=+42.632909226 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:46.965068 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.965029    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" event={"ID":"48cb9123-c805-44cf-a0f0-1dd46158c078","Type":"ContainerStarted","Data":"5e781e011290d267f4bba201202c2d22bfcabc258df9ebf3848f0cc2542ffa1f"}
Jul 23 01:28:46.990258 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:46.990196    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dlzwg" podStartSLOduration=8.518743128 podStartE2EDuration="37.99017746s" totalImagesPullingTime="29.471434332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:46.988920564 +0000 UTC m=+38.737980242" watchObservedRunningTime="2026-07-23 01:28:46.99017746 +0000 UTC m=+38.739237135"
Jul 23 01:28:47.139596 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.139491    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.228922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.228860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.429316 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.429244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.529247 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.529200    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.770060 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.769969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.870741 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.870703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:47.924142 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:47.924108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:50.813593 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.813559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:50.814101 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.813729    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:50.814101 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.813748    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:50.814101 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.813801    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.813786639 +0000 UTC m=+50.562846289 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:50.892202 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.892169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:50.914121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.914094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:50.914250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.914132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:50.914250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.914169    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:50.914250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.914208    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:50.914250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.914236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:50.914250 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914242    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914273    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.914255841 +0000 UTC m=+50.663315511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914301    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.914290237 +0000 UTC m=+50.663349893 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914345    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914361    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914401    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.914384837 +0000 UTC m=+50.663444492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914401    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914418    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.914411138 +0000 UTC m=+50.663470788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:50.914519 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:50.914487    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:28:58.914468759 +0000 UTC m=+50.663528428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:50.996798 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:50.996770    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:51.057307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:51.057287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:51.182491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:51.182453    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:51.284878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:51.284843    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:51.848946 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:51.848917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:51.906789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:51.906116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:52.256095 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.256070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:52.358944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.358912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:52.983825 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.983757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9jz9j" event={"ID":"9795fa52-04c5-454b-80aa-ee5d416b9a87","Type":"ContainerStarted","Data":"5caa9d71ac654bc65b1ab580a353538e97e7aec656b53f4d58dc9f3c838ac2fe"}
Jul 23 01:28:52.985683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.985473    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj" event={"ID":"03749fcc-052e-460d-95e1-33b3f0a2633e","Type":"ContainerStarted","Data":"e21fe4c4e5255431e5a3a74949622c148046050e1cbac7e5993e8120b64ec7e4"}
Jul 23 01:28:52.987146 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.987119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl" event={"ID":"6fd6d7af-60b7-469b-8c62-bd0baa77077b","Type":"ContainerStarted","Data":"edd2ff06ff4df5502e4772c59cf8261df466f3c6d7512cb7d8f9ca0aed66c8bd"}
Jul 23 01:28:52.988792 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.988738    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj" event={"ID":"960736d3-2bff-4ee9-94c2-0e6600842f0e","Type":"ContainerStarted","Data":"03aa9bc1d878cc38339f1ed395330791373ac027dc48fc6d7ad65272359f2ba7"}
Jul 23 01:28:52.990242 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.990223    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-l2zcp" event={"ID":"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11","Type":"ContainerStarted","Data":"18020308d554fb055dfb3b140fb2fa065323fcb9c55b3c490ed6c1f2da252cb5"}
Jul 23 01:28:52.991974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.991954    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/0.log"
Jul 23 01:28:52.992053 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.991995    2572 generic.go:356] "Generic (PLEG): container finished" podID="47e0cccc-44ce-4404-926a-586e3295e4aa" containerID="e178068969bc0b87316782f9a2fc9f138f750da416826a89cb285092f8302c00" exitCode=255
Jul 23 01:28:52.992053 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.992021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" event={"ID":"47e0cccc-44ce-4404-926a-586e3295e4aa","Type":"ContainerDied","Data":"e178068969bc0b87316782f9a2fc9f138f750da416826a89cb285092f8302c00"}
Jul 23 01:28:52.992261 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.992244    2572 scope.go:117] "RemoveContainer" containerID="e178068969bc0b87316782f9a2fc9f138f750da416826a89cb285092f8302c00"
Jul 23 01:28:52.994045 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.993985    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5" event={"ID":"e15d75ef-4a21-42a8-be94-2f354a6ab704","Type":"ContainerStarted","Data":"3b2bfebf9af912bc605e9f39268680f0d003549ab25586ee595102e29ad6803c"}
Jul 23 01:28:52.999502 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:52.999452    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9jz9j" podStartSLOduration=2.335498336 podStartE2EDuration="9.999419565s" totalImagesPullingTime="7.663921229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:52.997891448 +0000 UTC m=+44.746951121" watchObservedRunningTime="2026-07-23 01:28:52.999419565 +0000 UTC m=+44.748479239"
Jul 23 01:28:53.016553 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.016503    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-fjvxl" podStartSLOduration=17.483212495 podStartE2EDuration="25.016485952s" totalImagesPullingTime="7.533273457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:53.015059138 +0000 UTC m=+44.764118811" watchObservedRunningTime="2026-07-23 01:28:53.016485952 +0000 UTC m=+44.765545624"
Jul 23 01:28:53.036811 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.036005    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj" podStartSLOduration=17.373715758 podStartE2EDuration="25.035990233s" totalImagesPullingTime="7.662274475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:53.035396168 +0000 UTC m=+44.784455842" watchObservedRunningTime="2026-07-23 01:28:53.035990233 +0000 UTC m=+44.785049909"
Jul 23 01:28:53.069774 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.069747    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.093880 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.093822    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-q9lh5" podStartSLOduration=17.430243894 podStartE2EDuration="25.093805229s" totalImagesPullingTime="7.663561335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:53.075034723 +0000 UTC m=+44.824094396" watchObservedRunningTime="2026-07-23 01:28:53.093805229 +0000 UTC m=+44.842864903"
Jul 23 01:28:53.113824 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.113770    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-l2zcp" podStartSLOduration=17.4703418 podStartE2EDuration="25.113753072s" totalImagesPullingTime="7.643411272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:53.113188695 +0000 UTC m=+44.862248365" watchObservedRunningTime="2026-07-23 01:28:53.113753072 +0000 UTC m=+44.862812747"
Jul 23 01:28:53.114450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.114400    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj" podStartSLOduration=17.470394594 podStartE2EDuration="25.114386462s" totalImagesPullingTime="7.643991868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:28:53.095250966 +0000 UTC m=+44.844310637" watchObservedRunningTime="2026-07-23 01:28:53.114386462 +0000 UTC m=+44.863446138"
Jul 23 01:28:53.170794 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.170757    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.426130 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.426102    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:53.426253 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.426191    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:28:53.472719 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.472688    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.526704 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.526676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.796575 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.796491    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.891103 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.891069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:53.987499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:53.987463    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.001548 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.001529    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/1.log"
Jul 23 01:28:54.001988 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.001973    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/0.log"
Jul 23 01:28:54.002076 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.002007    2572 generic.go:356] "Generic (PLEG): container finished" podID="47e0cccc-44ce-4404-926a-586e3295e4aa" containerID="6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a" exitCode=255
Jul 23 01:28:54.002133 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.002096    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" event={"ID":"47e0cccc-44ce-4404-926a-586e3295e4aa","Type":"ContainerDied","Data":"6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a"}
Jul 23 01:28:54.002181 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.002148    2572 scope.go:117] "RemoveContainer" containerID="e178068969bc0b87316782f9a2fc9f138f750da416826a89cb285092f8302c00"
Jul 23 01:28:54.002368 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.002347    2572 scope.go:117] "RemoveContainer" containerID="6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a"
Jul 23 01:28:54.002579 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.002555    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2qmm2_openshift-console-operator(47e0cccc-44ce-4404-926a-586e3295e4aa)\"" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" podUID="47e0cccc-44ce-4404-926a-586e3295e4aa"
Jul 23 01:28:54.043278 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.043250    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zclsn"]
Jul 23 01:28:54.074134 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.074079    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zclsn"]
Jul 23 01:28:54.074249 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.074176    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.078451 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.078411    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hds2f\""
Jul 23 01:28:54.078769 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.078752    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 01:28:54.079265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.079249    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 01:28:54.081701 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.081668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.140126 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.140059    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.241526 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.241499    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54dadbdf-ddbe-46c7-875b-0de782b2daf0-data-volume\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.241675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.241543    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9wk\" (UniqueName: \"kubernetes.io/projected/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-api-access-wz9wk\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.241675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.241566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.241675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.241628    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.241675 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.241663    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54dadbdf-ddbe-46c7-875b-0de782b2daf0-crio-socket\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.277267 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.277238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.342411 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342340    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54dadbdf-ddbe-46c7-875b-0de782b2daf0-crio-socket\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342541 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342469    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54dadbdf-ddbe-46c7-875b-0de782b2daf0-data-volume\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342541 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342512    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9wk\" (UniqueName: \"kubernetes.io/projected/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-api-access-wz9wk\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342541 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342535    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342542    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54dadbdf-ddbe-46c7-875b-0de782b2daf0-crio-socket\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342619    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.342669 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.342633    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:54.342781 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.342682    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:54.842669353 +0000 UTC m=+46.591729003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:54.342781 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.342716    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 01:28:54.342781 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.342777    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:54.84276084 +0000 UTC m=+46.591820491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : configmap "kube-rbac-proxy" not found
Jul 23 01:28:54.342889 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.342850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54dadbdf-ddbe-46c7-875b-0de782b2daf0-data-volume\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.352421 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.352402    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9wk\" (UniqueName: \"kubernetes.io/projected/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-api-access-wz9wk\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.367618 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.367587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.422619 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.422594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.794859 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.794826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:54.845957 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.845932    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.846083 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:54.845983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:54.846083 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.846054    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 01:28:54.846083 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.846075    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:54.846183 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.846114    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:55.846100062 +0000 UTC m=+47.595159712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : configmap "kube-rbac-proxy" not found
Jul 23 01:28:54.846183 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:54.846128    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:55.846120991 +0000 UTC m=+47.595180641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:55.006527 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.006502    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/1.log"
Jul 23 01:28:55.006878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.006811    2572 scope.go:117] "RemoveContainer" containerID="6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a"
Jul 23 01:28:55.006986 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:55.006959    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-2qmm2_openshift-console-operator(47e0cccc-44ce-4404-926a-586e3295e4aa)\"" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" podUID="47e0cccc-44ce-4404-926a-586e3295e4aa"
Jul 23 01:28:55.144807 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.144723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:55.244792 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.244754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:55.853980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.853950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:55.854149 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:55.854072    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 01:28:55.854149 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:55.854134    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:57.854116929 +0000 UTC m=+49.603176579 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : configmap "kube-rbac-proxy" not found
Jul 23 01:28:55.854149 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:55.854075    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:55.854275 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:55.854149    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:55.854275 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:55.854203    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:28:57.854188842 +0000 UTC m=+49.603248495 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:56.321117 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:56.321057    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:56.422035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:56.422007    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:56.439980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:56.439958    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjtnk_baddff25-c286-4cec-ad32-4c9ff83a2dba/dns-node-resolver/0.log"
Jul 23 01:28:56.709886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:56.709842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:56.760055 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:56.760026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:57.440364 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:57.440334    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxp7v_4770b03e-179a-4468-b3b9-cd2466e2a664/node-ca/0.log"
Jul 23 01:28:57.524489 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:57.524460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:57.871788 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:57.871706    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:57.871788 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:57.871761    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:28:57.871962 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:57.871826    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 01:28:57.871962 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:57.871856    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:57.871962 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:57.871885    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:01.871872373 +0000 UTC m=+53.620932022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : configmap "kube-rbac-proxy" not found
Jul 23 01:28:57.871962 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:57.871915    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:01.871902012 +0000 UTC m=+53.620961662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : secret "insights-runtime-extractor-tls" not found
Jul 23 01:28:58.040465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.040425    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9jz9j_9795fa52-04c5-454b-80aa-ee5d416b9a87/serve-healthcheck-canary/0.log"
Jul 23 01:28:58.845228 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.845194    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-5f6qj_960736d3-2bff-4ee9-94c2-0e6600842f0e/kube-storage-version-migrator-operator/0.log"
Jul 23 01:28:58.879919 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.879891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:28:58.880063 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.880038    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 01:28:58.880063 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.880054    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67bf44f496-54nh5: secret "image-registry-tls" not found
Jul 23 01:28:58.880158 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.880102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls podName:d4256526-e6ff-4048-9bb7-d0e7b1327143 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.88008906 +0000 UTC m=+66.629148710 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls") pod "image-registry-67bf44f496-54nh5" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143") : secret "image-registry-tls" not found
Jul 23 01:28:58.981389 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.981353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:28:58.981571 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.981404    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:58.981571 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.981465    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:28:58.981571 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.981504    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:28:58.981571 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981521    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 01:28:58.981571 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:58.981534    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981571    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.981549285 +0000 UTC m=+66.730608946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : configmap references non-existent config key: service-ca.crt
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981597    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981607    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981615    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981668    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls podName:aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.981635368 +0000 UTC m=+66.730695033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls") pod "dns-default-5d624" (UID: "aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2") : secret "dns-default-metrics-tls" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981701    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls podName:7fb4982d-5610-4864-900a-bf65fc33709c nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.981689301 +0000 UTC m=+66.730748958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-42j5p" (UID: "7fb4982d-5610-4864-900a-bf65fc33709c") : secret "cluster-monitoring-operator-tls" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981720    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs podName:cd59b648-0a9e-4fcd-a87e-d581a9945b02 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.981711261 +0000 UTC m=+66.730770917 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs") pod "router-default-855fd99b4-5vxfg" (UID: "cd59b648-0a9e-4fcd-a87e-d581a9945b02") : secret "router-metrics-certs-default" not found
Jul 23 01:28:58.981790 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:28:58.981761    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls podName:d57d900d-6389-4547-b053-f843db29723c nodeName:}" failed. No retries permitted until 2026-07-23 01:29:14.981740525 +0000 UTC m=+66.730800179 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-wq5cg" (UID: "d57d900d-6389-4547-b053-f843db29723c") : secret "samples-operator-tls" not found
Jul 23 01:28:59.372600 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:59.372564    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:59.471142 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:59.471110    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:28:59.571319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:28:59.571291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:00.133575 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:00.133538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:00.599777 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:00.599735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:00.701690 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:00.701349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:00.800688 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:00.800654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:00.906996 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:00.906909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:01.023702 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:01.023664    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:01.486863 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:01.486832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:01.909682 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:01.909609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:01.909682 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:01.909669    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:01.909869 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:01.909757    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 01:29:01.909869 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:01.909822    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls podName:54dadbdf-ddbe-46c7-875b-0de782b2daf0 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:09.909805314 +0000 UTC m=+61.658864964 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zclsn" (UID: "54dadbdf-ddbe-46c7-875b-0de782b2daf0") : secret "insights-runtime-extractor-tls" not found
Jul 23 01:29:01.910190 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:01.910173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54dadbdf-ddbe-46c7-875b-0de782b2daf0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:02.084537 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:02.084501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:02.486099 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:02.486065    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:02.834698 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:02.834598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:02.933119 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:02.933088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:03.089860 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.089787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:03.338174 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.338132    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:03.426343 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.426320    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:03.426473 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.426368    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:03.426703 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.426690    2572 scope.go:117] "RemoveContainer" containerID="6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a"
Jul 23 01:29:03.485210 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.485185    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:03.884621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:03.884544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:04.042285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.042260    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:29:04.042766 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.042748    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/1.log"
Jul 23 01:29:04.042877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.042780    2572 generic.go:356] "Generic (PLEG): container finished" podID="47e0cccc-44ce-4404-926a-586e3295e4aa" containerID="bba1ee37d55462c6663f87609d0f1c20048d66d62715300a7ba38ecf39836eba" exitCode=255
Jul 23 01:29:04.042877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.042843    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" event={"ID":"47e0cccc-44ce-4404-926a-586e3295e4aa","Type":"ContainerDied","Data":"bba1ee37d55462c6663f87609d0f1c20048d66d62715300a7ba38ecf39836eba"}
Jul 23 01:29:04.042940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.042886    2572 scope.go:117] "RemoveContainer" containerID="6cdd811354e9aa650f2c94f671d267777ab6a20e48d4dedec6a33547f06bd44a"
Jul 23 01:29:04.043175 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.043158    2572 scope.go:117] "RemoveContainer" containerID="bba1ee37d55462c6663f87609d0f1c20048d66d62715300a7ba38ecf39836eba"
Jul 23 01:29:04.043368 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:04.043352    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2qmm2_openshift-console-operator(47e0cccc-44ce-4404-926a-586e3295e4aa)\"" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" podUID="47e0cccc-44ce-4404-926a-586e3295e4aa"
Jul 23 01:29:04.268336 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.268306    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:04.322734 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.322707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:04.480366 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:04.480336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:05.048202 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.048176    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:29:05.084033 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.084004    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:05.136332 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.136299    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:05.293704 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.293673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:05.493852 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.493814    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:05.899685 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:05.899607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:06.493090 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:06.493047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:06.867250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:06.867173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:07.091690 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:07.091652    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:07.291571 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:07.291536    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:07.687907 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:07.687875    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:07.882686 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:07.882653    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:08.088665 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:08.088589    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:08.920751 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:08.920727    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mcfzv"
Jul 23 01:29:09.081832 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.081792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:09.482580 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.482548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:09.682788 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.682733    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:09.880803 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.880715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:09.983312 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.983288    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:09.985556 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:09.985529    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54dadbdf-ddbe-46c7-875b-0de782b2daf0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zclsn\" (UID: \"54dadbdf-ddbe-46c7-875b-0de782b2daf0\") " pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:10.285496 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:10.285468    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hds2f\""
Jul 23 01:29:10.285715 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:10.285676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:10.294355 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:10.294338    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zclsn"
Jul 23 01:29:10.414855 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:10.414831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zclsn"]
Jul 23 01:29:10.417314 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:10.417287    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dadbdf_ddbe_46c7_875b_0de782b2daf0.slice/crio-41f1cf644e5b1412c5c656eb15a986b686726896ad2901cb21fe23e8d53df336 WatchSource:0}: Error finding container 41f1cf644e5b1412c5c656eb15a986b686726896ad2901cb21fe23e8d53df336: Status 404 returned error can't find the container with id 41f1cf644e5b1412c5c656eb15a986b686726896ad2901cb21fe23e8d53df336
Jul 23 01:29:10.698960 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:10.698923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:11.070937 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:11.070851    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zclsn" event={"ID":"54dadbdf-ddbe-46c7-875b-0de782b2daf0","Type":"ContainerStarted","Data":"41f1cf644e5b1412c5c656eb15a986b686726896ad2901cb21fe23e8d53df336"}
Jul 23 01:29:11.090086 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:11.089942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:11.286611 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:11.286579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:13.426234 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:13.426201    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:13.426646 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:13.426269    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:13.426723 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:13.426663    2572 scope.go:117] "RemoveContainer" containerID="bba1ee37d55462c6663f87609d0f1c20048d66d62715300a7ba38ecf39836eba"
Jul 23 01:29:13.426889 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:13.426846    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-2qmm2_openshift-console-operator(47e0cccc-44ce-4404-926a-586e3295e4aa)\"" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" podUID="47e0cccc-44ce-4404-926a-586e3295e4aa"
Jul 23 01:29:14.523289 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.523259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:29:14.523670 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.523320    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:29:14.525931 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.525910    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 01:29:14.526639 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.526624    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 01:29:14.536511 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.536479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a69a7473-d4c3-47a4-9d48-4bbb63fb889e-original-pull-secret\") pod \"global-pull-secret-syncer-dllpf\" (UID: \"a69a7473-d4c3-47a4-9d48-4bbb63fb889e\") " pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:29:14.536618 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.536517    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e3962fb-66de-43fa-b837-57ece6d1d56c-metrics-certs\") pod \"network-metrics-daemon-cfrth\" (UID: \"8e3962fb-66de-43fa-b837-57ece6d1d56c\") " pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:29:14.624855 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.624821    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:29:14.627723 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.627697    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkct4\" (UniqueName: \"kubernetes.io/projected/d5d49c25-0706-4670-9ea3-47ec15b5e6c8-kube-api-access-zkct4\") pod \"network-check-target-9qw2g\" (UID: \"d5d49c25-0706-4670-9ea3-47ec15b5e6c8\") " pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:29:14.656629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.656601    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-frx6l\""
Jul 23 01:29:14.664660 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.664630    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cfrth"
Jul 23 01:29:14.755363 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.755333    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lg5p2\""
Jul 23 01:29:14.757526 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.757500    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dllpf"
Jul 23 01:29:14.763185 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.763165    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:29:14.927785 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.927751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:29:14.930361 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:14.930328    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"image-registry-67bf44f496-54nh5\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") " pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:29:15.028948 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.028910    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:29:15.029131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.028957    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:15.029200 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.029143    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:15.029249 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.029204    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:29:15.029303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.029259    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:29:15.029700 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.029674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd59b648-0a9e-4fcd-a87e-d581a9945b02-service-ca-bundle\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:15.031699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.031656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2-metrics-tls\") pod \"dns-default-5d624\" (UID: \"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2\") " pod="openshift-dns/dns-default-5d624"
Jul 23 01:29:15.032073 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.032049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d57d900d-6389-4547-b053-f843db29723c-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-wq5cg\" (UID: \"d57d900d-6389-4547-b053-f843db29723c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:29:15.032171 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.032056    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fb4982d-5610-4864-900a-bf65fc33709c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-42j5p\" (UID: \"7fb4982d-5610-4864-900a-bf65fc33709c\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:29:15.032171 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.032093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd59b648-0a9e-4fcd-a87e-d581a9945b02-metrics-certs\") pod \"router-default-855fd99b4-5vxfg\" (UID: \"cd59b648-0a9e-4fcd-a87e-d581a9945b02\") " pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:15.187887 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.187857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6src\""
Jul 23 01:29:15.200358 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.196170    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:29:15.212191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.211975    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-lcbz2\""
Jul 23 01:29:15.219547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.219508    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"
Jul 23 01:29:15.234271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.234252    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjsgq\""
Jul 23 01:29:15.242309 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.242201    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5d624"
Jul 23 01:29:15.248729 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.248706    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ctqv7\""
Jul 23 01:29:15.256900 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.256874    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"
Jul 23 01:29:15.274076 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.274043    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3962fb_66de_43fa_b837_57ece6d1d56c.slice/crio-db8605d00a698344d87f43054c9fa88f9dbff1ef46b281aa136b68e73b1ca09a WatchSource:0}: Error finding container db8605d00a698344d87f43054c9fa88f9dbff1ef46b281aa136b68e73b1ca09a: Status 404 returned error can't find the container with id db8605d00a698344d87f43054c9fa88f9dbff1ef46b281aa136b68e73b1ca09a
Jul 23 01:29:15.274565 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.274410    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-gdrbc\""
Jul 23 01:29:15.277536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.276050    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cfrth"]
Jul 23 01:29:15.277536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.277103    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:15.287101 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.287078    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9qw2g"]
Jul 23 01:29:15.289264 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.289243    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d49c25_0706_4670_9ea3_47ec15b5e6c8.slice/crio-813cff2e764bcef26e0b005a06c4916988e79f09c89252bd7fbf14dccc8d17b6 WatchSource:0}: Error finding container 813cff2e764bcef26e0b005a06c4916988e79f09c89252bd7fbf14dccc8d17b6: Status 404 returned error can't find the container with id 813cff2e764bcef26e0b005a06c4916988e79f09c89252bd7fbf14dccc8d17b6
Jul 23 01:29:15.309709 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.309681    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dllpf"]
Jul 23 01:29:15.314225 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.314197    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69a7473_d4c3_47a4_9d48_4bbb63fb889e.slice/crio-d58d5d723b6359564c0bab8c5c0aabda30fa8bf714c76b66ebce623603cdfda6 WatchSource:0}: Error finding container d58d5d723b6359564c0bab8c5c0aabda30fa8bf714c76b66ebce623603cdfda6: Status 404 returned error can't find the container with id d58d5d723b6359564c0bab8c5c0aabda30fa8bf714c76b66ebce623603cdfda6
Jul 23 01:29:15.495970 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.495895    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5d624"]
Jul 23 01:29:15.503010 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.502968    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb49ca9_8ad9_404c_99d8_33d6f6dd98a2.slice/crio-922a5adf874d669b556b97843ab2ba91223d637009283d8084c0f28ec3dca7bf WatchSource:0}: Error finding container 922a5adf874d669b556b97843ab2ba91223d637009283d8084c0f28ec3dca7bf: Status 404 returned error can't find the container with id 922a5adf874d669b556b97843ab2ba91223d637009283d8084c0f28ec3dca7bf
Jul 23 01:29:15.519132 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.519108    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p"]
Jul 23 01:29:15.521484 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.521455    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fb4982d_5610_4864_900a_bf65fc33709c.slice/crio-e8c3e3a54a7b30f1c3e7457da4dd4369359919e374a9182317ce86f8761f9710 WatchSource:0}: Error finding container e8c3e3a54a7b30f1c3e7457da4dd4369359919e374a9182317ce86f8761f9710: Status 404 returned error can't find the container with id e8c3e3a54a7b30f1c3e7457da4dd4369359919e374a9182317ce86f8761f9710
Jul 23 01:29:15.524944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.524891    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:29:15.527617 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.527589    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4256526_e6ff_4048_9bb7_d0e7b1327143.slice/crio-09301451ef367a0ed6a975aeb6fc484ad3bd47e5fb5d6d04dbfb6ed8a6e52d02 WatchSource:0}: Error finding container 09301451ef367a0ed6a975aeb6fc484ad3bd47e5fb5d6d04dbfb6ed8a6e52d02: Status 404 returned error can't find the container with id 09301451ef367a0ed6a975aeb6fc484ad3bd47e5fb5d6d04dbfb6ed8a6e52d02
Jul 23 01:29:15.539300 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.539252    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg"]
Jul 23 01:29:15.557836 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:15.557812    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-855fd99b4-5vxfg"]
Jul 23 01:29:15.561078 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:15.561054    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd59b648_0a9e_4fcd_a87e_d581a9945b02.slice/crio-21d1647a6b053b366b5cca98d07d473b880a8e9feda98af21511276893a23e4a WatchSource:0}: Error finding container 21d1647a6b053b366b5cca98d07d473b880a8e9feda98af21511276893a23e4a: Status 404 returned error can't find the container with id 21d1647a6b053b366b5cca98d07d473b880a8e9feda98af21511276893a23e4a
Jul 23 01:29:16.092464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.092207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zclsn" event={"ID":"54dadbdf-ddbe-46c7-875b-0de782b2daf0","Type":"ContainerStarted","Data":"426afe2ef2528d7f43f995472802f7864aa2db0363a0d6cb906ac6ad88c15228"}
Jul 23 01:29:16.094161 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.094129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-855fd99b4-5vxfg" event={"ID":"cd59b648-0a9e-4fcd-a87e-d581a9945b02","Type":"ContainerStarted","Data":"6c5fd0dfc53347691e5190fb2498cc4c46981a180f7a81214b22ddf955c534e2"}
Jul 23 01:29:16.094282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.094181    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-855fd99b4-5vxfg" event={"ID":"cd59b648-0a9e-4fcd-a87e-d581a9945b02","Type":"ContainerStarted","Data":"21d1647a6b053b366b5cca98d07d473b880a8e9feda98af21511276893a23e4a"}
Jul 23 01:29:16.095869 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.095812    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5d624" event={"ID":"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2","Type":"ContainerStarted","Data":"922a5adf874d669b556b97843ab2ba91223d637009283d8084c0f28ec3dca7bf"}
Jul 23 01:29:16.097424 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.097381    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p" event={"ID":"7fb4982d-5610-4864-900a-bf65fc33709c","Type":"ContainerStarted","Data":"e8c3e3a54a7b30f1c3e7457da4dd4369359919e374a9182317ce86f8761f9710"}
Jul 23 01:29:16.100990 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.100963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" event={"ID":"d4256526-e6ff-4048-9bb7-d0e7b1327143","Type":"ContainerStarted","Data":"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"}
Jul 23 01:29:16.101093 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.101007    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" event={"ID":"d4256526-e6ff-4048-9bb7-d0e7b1327143","Type":"ContainerStarted","Data":"09301451ef367a0ed6a975aeb6fc484ad3bd47e5fb5d6d04dbfb6ed8a6e52d02"}
Jul 23 01:29:16.101093 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.101054    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:29:16.102371 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.102346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfrth" event={"ID":"8e3962fb-66de-43fa-b837-57ece6d1d56c","Type":"ContainerStarted","Data":"db8605d00a698344d87f43054c9fa88f9dbff1ef46b281aa136b68e73b1ca09a"}
Jul 23 01:29:16.104594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.104568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9qw2g" event={"ID":"d5d49c25-0706-4670-9ea3-47ec15b5e6c8","Type":"ContainerStarted","Data":"2af6cd06805572e25265f152e892f00d7ee86662bd15db27b8f69fbd2a56be09"}
Jul 23 01:29:16.104695 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.104651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9qw2g" event={"ID":"d5d49c25-0706-4670-9ea3-47ec15b5e6c8","Type":"ContainerStarted","Data":"813cff2e764bcef26e0b005a06c4916988e79f09c89252bd7fbf14dccc8d17b6"}
Jul 23 01:29:16.104876 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.104843    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:29:16.106624 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.106600    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg" event={"ID":"d57d900d-6389-4547-b053-f843db29723c","Type":"ContainerStarted","Data":"7b086bb65740782a1674735db03057bfc6edbca47af738f6524ee1db01fe0201"}
Jul 23 01:29:16.108255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.108206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dllpf" event={"ID":"a69a7473-d4c3-47a4-9d48-4bbb63fb889e","Type":"ContainerStarted","Data":"d58d5d723b6359564c0bab8c5c0aabda30fa8bf714c76b66ebce623603cdfda6"}
Jul 23 01:29:16.113386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.113332    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-855fd99b4-5vxfg" podStartSLOduration=48.113315189 podStartE2EDuration="48.113315189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:16.111592212 +0000 UTC m=+67.860651881" watchObservedRunningTime="2026-07-23 01:29:16.113315189 +0000 UTC m=+67.862374863"
Jul 23 01:29:16.129601 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.129539    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" podStartSLOduration=67.129522398 podStartE2EDuration="1m7.129522398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:16.128855816 +0000 UTC m=+67.877915485" watchObservedRunningTime="2026-07-23 01:29:16.129522398 +0000 UTC m=+67.878582072"
Jul 23 01:29:16.143994 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.143942    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9qw2g" podStartSLOduration=67.143925028 podStartE2EDuration="1m7.143925028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:16.142803391 +0000 UTC m=+67.891863064" watchObservedRunningTime="2026-07-23 01:29:16.143925028 +0000 UTC m=+67.892984698"
Jul 23 01:29:16.278141 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.278061    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:16.281131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:16.280953    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:17.114336 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:17.114311    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:17.115742 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:17.115720    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-855fd99b4-5vxfg"
Jul 23 01:29:17.847054 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:17.846953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:17.904059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:17.904012    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:18.123288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:18.123191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfrth" event={"ID":"8e3962fb-66de-43fa-b837-57ece6d1d56c","Type":"ContainerStarted","Data":"552a79ff5179cf0e56bef92e1e61ce8d1f9a6f745bceaf4c60a3666cf0248856"}
Jul 23 01:29:18.123765 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:18.123292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cfrth" event={"ID":"8e3962fb-66de-43fa-b837-57ece6d1d56c","Type":"ContainerStarted","Data":"e7ca433ed9f013d651216a25867905d5ffc4b7209ba8cfb5ad5231d47ba6c648"}
Jul 23 01:29:18.142672 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:18.142619    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cfrth" podStartSLOduration=67.454709422 podStartE2EDuration="1m9.142600501s" totalImagesPullingTime="1.687891079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:18.142065128 +0000 UTC m=+69.891124801" watchObservedRunningTime="2026-07-23 01:29:18.142600501 +0000 UTC m=+69.891660175"
Jul 23 01:29:20.754288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.753507    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"]
Jul 23 01:29:20.834538 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.834485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:20.917452 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.917410    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"]
Jul 23 01:29:20.917657 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.917583    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.917657 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.917590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:20.920179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.919903    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 23 01:29:20.920179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920005    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 01:29:20.920179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920032    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 23 01:29:20.920179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920032    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 01:29:20.920179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920151    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 23 01:29:20.920536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920429    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 01:29:20.920884 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.920864    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 23 01:29:20.982264 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.982380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982275    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.982380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.982380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982367    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.982507 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:20.982507 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:20.982485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxfk\" (UniqueName: \"kubernetes.io/projected/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-kube-api-access-9hxfk\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.018998 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.018974    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:21.082901 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.082871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.083059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.082909    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.083059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.082933    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.083059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.082954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.083059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.082969    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxfk\" (UniqueName: \"kubernetes.io/projected/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-kube-api-access-9hxfk\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.083852 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.083783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.084699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.084250    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.086946 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.086921    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.087040 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.086998    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.091401 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.091382    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.091522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.091380    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-ca\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.092311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.092289    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxfk\" (UniqueName: \"kubernetes.io/projected/dceaf5d9-f7a0-44af-bd0b-a45038394cb4-kube-api-access-9hxfk\") pod \"cluster-proxy-proxy-agent-6ccfb59f76-rrpgn\" (UID: \"dceaf5d9-f7a0-44af-bd0b-a45038394cb4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.216994 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.216931    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:21.234981 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.234928    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"
Jul 23 01:29:21.272877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:21.272851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:23.743152 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:23.743123    2572 scope.go:117] "RemoveContainer" containerID="bba1ee37d55462c6663f87609d0f1c20048d66d62715300a7ba38ecf39836eba"
Jul 23 01:29:24.031909 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.031796    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn"]
Jul 23 01:29:24.045195 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:24.045151    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddceaf5d9_f7a0_44af_bd0b_a45038394cb4.slice/crio-c1b0f476d77b633aea3bc9820550b2622abba329729d6a7f51a4832351c182b4 WatchSource:0}: Error finding container c1b0f476d77b633aea3bc9820550b2622abba329729d6a7f51a4832351c182b4: Status 404 returned error can't find the container with id c1b0f476d77b633aea3bc9820550b2622abba329729d6a7f51a4832351c182b4
Jul 23 01:29:24.146386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.146342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn" event={"ID":"dceaf5d9-f7a0-44af-bd0b-a45038394cb4","Type":"ContainerStarted","Data":"c1b0f476d77b633aea3bc9820550b2622abba329729d6a7f51a4832351c182b4"}
Jul 23 01:29:24.148364 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.148296    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg" event={"ID":"d57d900d-6389-4547-b053-f843db29723c","Type":"ContainerStarted","Data":"af11bcdc581d1a51249b4244e5e18d401da1dc1c0ef69dddc3e40dca3cc8c55d"}
Jul 23 01:29:24.150043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.150017    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dllpf" event={"ID":"a69a7473-d4c3-47a4-9d48-4bbb63fb889e","Type":"ContainerStarted","Data":"d4cbaacca522f6164ee413e0922c58dc8568afadc7c2b7f2ac7b7f96a667cd52"}
Jul 23 01:29:24.152189 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.152114    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5d624" event={"ID":"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2","Type":"ContainerStarted","Data":"63381fe443af2d0ec38e097ccf4caf6b42ab900c19abbb0b53b4dbbb3f34b63d"}
Jul 23 01:29:24.153945 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.153917    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p" event={"ID":"7fb4982d-5610-4864-900a-bf65fc33709c","Type":"ContainerStarted","Data":"663bbfe608f33845e6dd049b45353c499ddfff1453ae0b657d9f38c53267c80e"}
Jul 23 01:29:24.157044 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.157027    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:29:24.157118 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.157085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" event={"ID":"47e0cccc-44ce-4404-926a-586e3295e4aa","Type":"ContainerStarted","Data":"a81753e92c8d41dd443dc2655b3016240bbfa5e77d76275e81ba4701822111e2"}
Jul 23 01:29:24.157467 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.157405    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:24.168531 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.168470    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dllpf" podStartSLOduration=66.579002044 podStartE2EDuration="1m15.168452301s" totalImagesPullingTime="8.589450257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:24.167857977 +0000 UTC m=+75.916917651" watchObservedRunningTime="2026-07-23 01:29:24.168452301 +0000 UTC m=+75.917511971"
Jul 23 01:29:24.185451 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.184195    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-42j5p" podStartSLOduration=48.137650061 podStartE2EDuration="56.184180353s" totalImagesPullingTime="8.046530292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:24.18200502 +0000 UTC m=+75.931064693" watchObservedRunningTime="2026-07-23 01:29:24.184180353 +0000 UTC m=+75.933240026"
Jul 23 01:29:24.304100 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.303917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:24.491895 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.491861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:24.818645 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.818500    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:24.981677 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.981447    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2"
Jul 23 01:29:24.998856 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:24.998559    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-2qmm2" podStartSLOduration=49.30479038 podStartE2EDuration="56.998543702s" totalImagesPullingTime="7.693753322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:24.201680494 +0000 UTC m=+75.950740170" watchObservedRunningTime="2026-07-23 01:29:24.998543702 +0000 UTC m=+76.747603373"
Jul 23 01:29:25.169160 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.169103    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zclsn" event={"ID":"54dadbdf-ddbe-46c7-875b-0de782b2daf0","Type":"ContainerStarted","Data":"154bc64ccee82d2a0c5a73c85cbe31e436c921487aac680fe3edd0dfb573f388"}
Jul 23 01:29:25.174886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.174850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5d624" event={"ID":"aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2","Type":"ContainerStarted","Data":"c1c5bf96da1a656efd3f6690bd97cd537a33e64b55ee9381726d857717b1f028"}
Jul 23 01:29:25.175044 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.174978    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5d624"
Jul 23 01:29:25.177351 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.177261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.179109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.178720    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg" event={"ID":"d57d900d-6389-4547-b053-f843db29723c","Type":"ContainerStarted","Data":"f91ac9d824d581aab9981437c25e4f62e56c5a58041de55263fa5fbb25eb2617"}
Jul 23 01:29:25.218838 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.218156    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5d624" podStartSLOduration=33.834170414 podStartE2EDuration="42.218135123s" totalImagesPullingTime="8.383964709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:25.200767534 +0000 UTC m=+76.949827198" watchObservedRunningTime="2026-07-23 01:29:25.218135123 +0000 UTC m=+76.967194798"
Jul 23 01:29:25.219855 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.219604    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-wq5cg" podStartSLOduration=48.976384119 podStartE2EDuration="57.219584826s" totalImagesPullingTime="8.243200707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:25.218078766 +0000 UTC m=+76.967138441" watchObservedRunningTime="2026-07-23 01:29:25.219584826 +0000 UTC m=+76.968644698"
Jul 23 01:29:25.236897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.236850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.290951 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.290921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.456373 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.456208    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.751075 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.750894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.815655 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.815568    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:25.916162 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:25.916132    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:26.722794 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:26.722754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:26.859695 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:26.859658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:26.916356 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:26.916314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:27.055889 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:27.055816    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:27.245242 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:27.245159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:27.457476 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:27.457426    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:29.243344 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:29.243305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:29.296404 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:29.296367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:29.816313 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:29.816220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:29.908904 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:29.908869    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:30.203192 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.203153    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn" event={"ID":"dceaf5d9-f7a0-44af-bd0b-a45038394cb4","Type":"ContainerStarted","Data":"6e49d2f07c9ad89acff9f8b5deb2e7986b103e21f5195e108cb1e538f45f5fa7"}
Jul 23 01:29:30.203367 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.203206    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn" event={"ID":"dceaf5d9-f7a0-44af-bd0b-a45038394cb4","Type":"ContainerStarted","Data":"af0fb49578c0da7a889d70d9f33688891935446024e55f03bb157e03e432bba8"}
Jul 23 01:29:30.203367 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.203222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn" event={"ID":"dceaf5d9-f7a0-44af-bd0b-a45038394cb4","Type":"ContainerStarted","Data":"4c68f3c1cfe6df02cbeebe60a3fcfc154050af6729ad61baf918fcba1064fa4f"}
Jul 23 01:29:30.205204 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.205177    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zclsn" event={"ID":"54dadbdf-ddbe-46c7-875b-0de782b2daf0","Type":"ContainerStarted","Data":"53ae47f9679b920d3b3979cb1d4d480fb3f94fd8e68586a84ea4dfa88baab6bb"}
Jul 23 01:29:30.221379 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.221340    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ccfb59f76-rrpgn" podStartSLOduration=4.876917842 podStartE2EDuration="10.221328383s" totalImagesPullingTime="5.344410541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:29:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:30.220275344 +0000 UTC m=+81.969335029" watchObservedRunningTime="2026-07-23 01:29:30.221328383 +0000 UTC m=+81.970388033"
Jul 23 01:29:30.237178 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.237128    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zclsn" podStartSLOduration=17.552451993 podStartE2EDuration="36.237112643s" totalImagesPullingTime="18.68466065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 01:28:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:30.235759418 +0000 UTC m=+81.984819091" watchObservedRunningTime="2026-07-23 01:29:30.237112643 +0000 UTC m=+81.986172314"
Jul 23 01:29:30.562564 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.562486    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:30.621627 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:30.621595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:31.504401 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:31.504285    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:31.605218 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:31.605184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:32.071785 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:32.071752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:35.179485 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:35.179457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:35.186923 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:35.186901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5d624"
Jul 23 01:29:35.201273 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:35.201246    2572 patch_prober.go:28] interesting pod/image-registry-67bf44f496-54nh5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 01:29:35.201366 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:35.201293    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 01:29:36.491288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.491255    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:36.554752 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.554722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:36.648271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.648237    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:36.768120 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.768048    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:36.872485 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.872428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:36.918323 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.918292    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wkrkk"]
Jul 23 01:29:36.921564 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.921544    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:36.924283 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.924260    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 01:29:36.924390 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.924357    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nh4h7\""
Jul 23 01:29:36.924468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.924388    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 01:29:36.926024 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.926002    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 01:29:36.926127 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.926030    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 01:29:36.968539 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:36.968516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.016591 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-wtmp\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016606    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-sys\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995kc\" (UniqueName: \"kubernetes.io/projected/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-kube-api-access-995kc\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016842 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016715    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-textfile\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016842 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016752    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-root\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016842 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016956 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016847    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-metrics-client-ca\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016956 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.016956 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.016903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117352 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117292    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117352 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117334    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-wtmp\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117388    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-sys\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995kc\" (UniqueName: \"kubernetes.io/projected/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-kube-api-access-995kc\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117471    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-textfile\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-root\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-sys\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-wtmp\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117574    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-metrics-client-ca\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-root\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117617    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:37.117731    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:29:37.117789    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls podName:08a1bf35-fe43-4968-93d7-63b69f4d8cf3 nodeName:}" failed. No retries permitted until 2026-07-23 01:29:37.617770121 +0000 UTC m=+89.366829770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls") pod "node-exporter-wkrkk" (UID: "08a1bf35-fe43-4968-93d7-63b69f4d8cf3") : secret "node-exporter-tls" not found
Jul 23 01:29:37.117968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117945    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.118232 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.117978    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-textfile\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.118232 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.118144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-metrics-client-ca\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.119682 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.119666    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.127869 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.127822    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-995kc\" (UniqueName: \"kubernetes.io/projected/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-kube-api-access-995kc\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.177970 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.177946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.276944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.276912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.376276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.376187    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.477621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.477594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.578777 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.578751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.621004 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.620978    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.623215 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.623197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/08a1bf35-fe43-4968-93d7-63b69f4d8cf3-node-exporter-tls\") pod \"node-exporter-wkrkk\" (UID: \"08a1bf35-fe43-4968-93d7-63b69f4d8cf3\") " pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.829984 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.829954    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wkrkk"
Jul 23 01:29:37.840369 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:29:37.840340    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08a1bf35_fe43_4968_93d7_63b69f4d8cf3.slice/crio-19f6b8e96d286121567d137fe9222b51996fc3fe0e812d385b23236ba7830d74 WatchSource:0}: Error finding container 19f6b8e96d286121567d137fe9222b51996fc3fe0e812d385b23236ba7830d74: Status 404 returned error can't find the container with id 19f6b8e96d286121567d137fe9222b51996fc3fe0e812d385b23236ba7830d74
Jul 23 01:29:37.891651 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.891627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:37.974781 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:37.974753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:38.207680 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:38.207646    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:38.236902 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:38.236875    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkrkk" event={"ID":"08a1bf35-fe43-4968-93d7-63b69f4d8cf3","Type":"ContainerStarted","Data":"19f6b8e96d286121567d137fe9222b51996fc3fe0e812d385b23236ba7830d74"}
Jul 23 01:29:39.241712 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:39.241676    2572 generic.go:356] "Generic (PLEG): container finished" podID="08a1bf35-fe43-4968-93d7-63b69f4d8cf3" containerID="e453244076a406ccc382674b4f36b84600cadaffd22191011695aac6bc1353b1" exitCode=0
Jul 23 01:29:39.242062 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:39.241744    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkrkk" event={"ID":"08a1bf35-fe43-4968-93d7-63b69f4d8cf3","Type":"ContainerDied","Data":"e453244076a406ccc382674b4f36b84600cadaffd22191011695aac6bc1353b1"}
Jul 23 01:29:39.865097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:39.865066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:39.964245 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:39.964210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:40.063694 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:40.063667    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:40.247192 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:40.247161    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkrkk" event={"ID":"08a1bf35-fe43-4968-93d7-63b69f4d8cf3","Type":"ContainerStarted","Data":"a4e2fa8267adcf35c490c48b222b62172a36004940f1376a79311fcf3e398f6f"}
Jul 23 01:29:40.247621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:40.247211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wkrkk" event={"ID":"08a1bf35-fe43-4968-93d7-63b69f4d8cf3","Type":"ContainerStarted","Data":"d4a48790a9f9148310062de3843e64e1c9cb8da61201d2dab28d9c11bc31dda1"}
Jul 23 01:29:40.265928 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:40.265878    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wkrkk" podStartSLOduration=3.307309754 podStartE2EDuration="4.265863464s" totalImagesPullingTime="893.86264ms" totalInitContainerRuntime="64.69107ms" isStatefulPod=true podCreationTimestamp="2026-07-23 01:29:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:29:40.265635088 +0000 UTC m=+92.014694759" watchObservedRunningTime="2026-07-23 01:29:40.265863464 +0000 UTC m=+92.014923166"
Jul 23 01:29:40.362130 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:40.362100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:41.666527 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:41.666499    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:41.725118 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:41.725089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:41.975876 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:41.975798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:43.140367 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:43.140329    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:43.487397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:43.487366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:46.420567 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:46.420540    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:29:46.498915 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:46.498880    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:46.582462 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:46.582422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:47.116512 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:47.116482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9qw2g"
Jul 23 01:29:47.121016 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:47.120906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:47.222110 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:47.222072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:47.370707 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:47.370651    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:47.419120 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:47.419086    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:49.693829 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:49.693787    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:49.785787 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:49.785758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:51.240028 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:51.239993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:51.334421 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:51.334390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:51.434110 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:51.434077    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:52.129872 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:52.129827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:52.228366 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:52.228273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:52.507874 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:52.507843    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:56.440349 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:56.440314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:56.539022 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:56.538991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:57.404859 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:57.404828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:57.456418 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:57.456388    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:57.666066 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:57.666035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:57.715469 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:57.715427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:29:57.789118 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:29:57.789090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:02.875796 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:02.875754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:02.977423 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:02.977390    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:03.326519 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:03.326488    2572 generic.go:356] "Generic (PLEG): container finished" podID="960736d3-2bff-4ee9-94c2-0e6600842f0e" containerID="03aa9bc1d878cc38339f1ed395330791373ac027dc48fc6d7ad65272359f2ba7" exitCode=0
Jul 23 01:30:03.326679 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:03.326528    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj" event={"ID":"960736d3-2bff-4ee9-94c2-0e6600842f0e","Type":"ContainerDied","Data":"03aa9bc1d878cc38339f1ed395330791373ac027dc48fc6d7ad65272359f2ba7"}
Jul 23 01:30:03.326847 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:03.326834    2572 scope.go:117] "RemoveContainer" containerID="03aa9bc1d878cc38339f1ed395330791373ac027dc48fc6d7ad65272359f2ba7"
Jul 23 01:30:04.331586 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:04.331555    2572 generic.go:356] "Generic (PLEG): container finished" podID="03749fcc-052e-460d-95e1-33b3f0a2633e" containerID="e21fe4c4e5255431e5a3a74949622c148046050e1cbac7e5993e8120b64ec7e4" exitCode=0
Jul 23 01:30:04.332040 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:04.331633    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj" event={"ID":"03749fcc-052e-460d-95e1-33b3f0a2633e","Type":"ContainerDied","Data":"e21fe4c4e5255431e5a3a74949622c148046050e1cbac7e5993e8120b64ec7e4"}
Jul 23 01:30:04.332040 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:04.331985    2572 scope.go:117] "RemoveContainer" containerID="e21fe4c4e5255431e5a3a74949622c148046050e1cbac7e5993e8120b64ec7e4"
Jul 23 01:30:04.333352 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:04.333323    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-5f6qj" event={"ID":"960736d3-2bff-4ee9-94c2-0e6600842f0e","Type":"ContainerStarted","Data":"8d145abaa99fa39c8f5f728f64895570b925d78a6ee155a1b23d610ad638d853"}
Jul 23 01:30:05.338895 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:05.338864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-5gwmj" event={"ID":"03749fcc-052e-460d-95e1-33b3f0a2633e","Type":"ContainerStarted","Data":"a08b7c6aaa66060e622be80b13d057a260e817cfc5cd4df17f4c6ed6c6b56042"}
Jul 23 01:30:06.040979 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:06.040941    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:11.447340 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.447279    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerName="registry" containerID="cri-o://6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8" gracePeriod=30
Jul 23 01:30:11.692414 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.692388    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:30:11.767409 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767351    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767409 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767388    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767594 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767621    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sllqv\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767649    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767757 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767716    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767815 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767754    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") pod \"d4256526-e6ff-4048-9bb7-d0e7b1327143\" (UID: \"d4256526-e6ff-4048-9bb7-d0e7b1327143\") "
Jul 23 01:30:11.767815 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767791    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:30:11.767917 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.767841    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:30:11.768109 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.768084    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-trusted-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.768205 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.768115    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-certificates\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.770157 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.770114    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:30:11.770157 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.770121    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:30:11.770315 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.770162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:30:11.770315 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.770189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:30:11.770315 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.770231    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv" (OuterVolumeSpecName: "kube-api-access-sllqv") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "kube-api-access-sllqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:30:11.776301 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.776278    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d4256526-e6ff-4048-9bb7-d0e7b1327143" (UID: "d4256526-e6ff-4048-9bb7-d0e7b1327143"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:30:11.868672 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868645    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-registry-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.868672 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868670    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-image-registry-private-configuration\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.868820 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868679    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d4256526-e6ff-4048-9bb7-d0e7b1327143-installation-pull-secrets\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.868820 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868687    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sllqv\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-kube-api-access-sllqv\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.868820 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868697    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d4256526-e6ff-4048-9bb7-d0e7b1327143-bound-sa-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:11.868820 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:11.868705    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d4256526-e6ff-4048-9bb7-d0e7b1327143-ca-trust-extracted\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:30:12.363823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.363793    2572 generic.go:356] "Generic (PLEG): container finished" podID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerID="6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8" exitCode=0
Jul 23 01:30:12.363975 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.363835    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67bf44f496-54nh5"
Jul 23 01:30:12.363975 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.363856    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" event={"ID":"d4256526-e6ff-4048-9bb7-d0e7b1327143","Type":"ContainerDied","Data":"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"}
Jul 23 01:30:12.363975 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.363895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67bf44f496-54nh5" event={"ID":"d4256526-e6ff-4048-9bb7-d0e7b1327143","Type":"ContainerDied","Data":"09301451ef367a0ed6a975aeb6fc484ad3bd47e5fb5d6d04dbfb6ed8a6e52d02"}
Jul 23 01:30:12.363975 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.363915    2572 scope.go:117] "RemoveContainer" containerID="6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"
Jul 23 01:30:12.372586 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.372568    2572 scope.go:117] "RemoveContainer" containerID="6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"
Jul 23 01:30:12.372862 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:30:12.372841    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8\": container with ID starting with 6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8 not found: ID does not exist" containerID="6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"
Jul 23 01:30:12.372913 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.372869    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8"} err="failed to get container status \"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8\": rpc error: code = NotFound desc = could not find container \"6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8\": container with ID starting with 6dd53e815fcd62e2a71a1951090af86b7ba2b7af9a74776d9f10ca80eb2619b8 not found: ID does not exist"
Jul 23 01:30:12.384515 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.384494    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:30:12.388522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.388500    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67bf44f496-54nh5"]
Jul 23 01:30:12.747222 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:12.747195    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" path="/var/lib/kubelet/pods/d4256526-e6ff-4048-9bb7-d0e7b1327143/volumes"
Jul 23 01:30:13.368211 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:13.368185    2572 generic.go:356] "Generic (PLEG): container finished" podID="6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11" containerID="18020308d554fb055dfb3b140fb2fa065323fcb9c55b3c490ed6c1f2da252cb5" exitCode=0
Jul 23 01:30:13.368374 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:13.368263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-l2zcp" event={"ID":"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11","Type":"ContainerDied","Data":"18020308d554fb055dfb3b140fb2fa065323fcb9c55b3c490ed6c1f2da252cb5"}
Jul 23 01:30:13.368626 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:13.368608    2572 scope.go:117] "RemoveContainer" containerID="18020308d554fb055dfb3b140fb2fa065323fcb9c55b3c490ed6c1f2da252cb5"
Jul 23 01:30:14.378525 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:14.378491    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-l2zcp" event={"ID":"6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11","Type":"ContainerStarted","Data":"664db0c62c5fd1b48ac618c5088ba9882ce3cd44e0038df25f71bcb6f4abb045"}
Jul 23 01:30:17.837655 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:17.837623    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:17.893414 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:17.893385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:46.130650 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:46.130610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:46.364321 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:46.364289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:55.496547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:55.496513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:30:55.574511 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:30:55.574478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:05.940478 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:05.940389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:06.042074 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:06.042033    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:06.111412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:06.111382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:22.593292 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:22.593245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:44.435727 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:44.435682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:31:44.489330 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:31:44.489295    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:01.362403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:01.362366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:01.427389 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:01.427359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:13.362705 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:13.362664    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:13.416248 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:13.416206    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:15.028159 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:15.028123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:15.081480 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:15.081427    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:17.842399 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:17.842362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:17.942410 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:17.942368    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:26.187145 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:26.187112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:26.237516 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:26.237483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:26.292375 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:26.292346    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:32:37.314999 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:32:37.314888    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:08.673055 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:08.673028    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:33:08.682329 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:08.682308    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 01:33:08.682494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:08.682377    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:33:13.242380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:13.242340    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:14.448964 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:14.448924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:34.921787 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:34.921746    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:35.690068 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:35.690030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:35.787797 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:35.787772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:35.888259 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:35.888226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:38.338160 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:38.338101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:38.441507 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:38.441428    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:39.640273 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:39.640221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:39.743688 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:39.743660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:40.664333 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:40.664296    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:40.773414 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:40.773380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:42.690821 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:42.690793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:43.074542 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:43.074462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:45.335221 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:45.335185    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:45.437721 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:45.437694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:47.698680 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:47.698636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:47.752633 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:47.752598    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:48.937373 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:48.937323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:49.033905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:49.033874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:51.277211 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:51.277173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:54.952901 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:54.952864    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:55.053828 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:55.053794    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:33:57.117583 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:33:57.117554    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:09.791042 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:09.790959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:09.887128 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:09.887093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.344191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.344159    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.590544 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.590493    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.692116 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.692089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.712284 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.712263    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"]
Jul 23 01:34:10.712555 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.712541    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerName="registry"
Jul 23 01:34:10.712603 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.712558    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerName="registry"
Jul 23 01:34:10.712637 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.712624    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4256526-e6ff-4048-9bb7-d0e7b1327143" containerName="registry"
Jul 23 01:34:10.715693 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.715677    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.718169 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.718145    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 01:34:10.718274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.718160    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 01:34:10.718274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.718164    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 01:34:10.718274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.718232    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zdsb9\""
Jul 23 01:34:10.718274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.718239    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 01:34:10.729708 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.729687    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"]
Jul 23 01:34:10.844199 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.844173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.863397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.863373    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.863508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.863407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.863508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.863428    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mnrs\" (UniqueName: \"kubernetes.io/projected/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-kube-api-access-9mnrs\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.863587 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.863536    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-tmp\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.863587 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.863575    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-manifests\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.945187 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.945137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:10.964364 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964346    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-manifests\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.964467 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.964467 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964423    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.964540 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964466    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mnrs\" (UniqueName: \"kubernetes.io/projected/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-kube-api-access-9mnrs\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.964540 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964509    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-tmp\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.964816 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.964796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-manifests\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.966814 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.966795    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-tmp\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.966934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.966918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.966997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.966938    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:10.971901 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:10.971880    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mnrs\" (UniqueName: \"kubernetes.io/projected/36f69a5d-caf9-4cf7-b89b-a775b6c8cc30-kube-api-access-9mnrs\") pod \"opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk\" (UID: \"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30\") " pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:11.025921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.025886    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:11.045895 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.045868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:11.146190 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.146152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:11.161714 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.161691    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"]
Jul 23 01:34:11.164497 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:34:11.164471    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f69a5d_caf9_4cf7_b89b_a775b6c8cc30.slice/crio-8425ba7f44f11d893b6c8158b80525125325b39f73710844af88abaa255b7717 WatchSource:0}: Error finding container 8425ba7f44f11d893b6c8158b80525125325b39f73710844af88abaa255b7717: Status 404 returned error can't find the container with id 8425ba7f44f11d893b6c8158b80525125325b39f73710844af88abaa255b7717
Jul 23 01:34:11.166320 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.166304    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 01:34:11.222380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.222299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk" event={"ID":"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30","Type":"ContainerStarted","Data":"8425ba7f44f11d893b6c8158b80525125325b39f73710844af88abaa255b7717"}
Jul 23 01:34:11.277687 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.277655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:11.373900 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:11.373868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:13.371654 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:13.371618    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:13.476716 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:13.476669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:15.241416 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:15.241384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk" event={"ID":"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30","Type":"ContainerStarted","Data":"644699a9ddd9f2e4d48f352d964d254533f212a4a9f3dde7d3ab1025d57b32d3"}
Jul 23 01:34:16.246144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:16.246103    2572 generic.go:356] "Generic (PLEG): container finished" podID="36f69a5d-caf9-4cf7-b89b-a775b6c8cc30" containerID="644699a9ddd9f2e4d48f352d964d254533f212a4a9f3dde7d3ab1025d57b32d3" exitCode=0
Jul 23 01:34:16.246583 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:16.246187    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk" event={"ID":"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30","Type":"ContainerDied","Data":"644699a9ddd9f2e4d48f352d964d254533f212a4a9f3dde7d3ab1025d57b32d3"}
Jul 23 01:34:17.251995 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:17.251964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk" event={"ID":"36f69a5d-caf9-4cf7-b89b-a775b6c8cc30","Type":"ContainerStarted","Data":"bb73f9fab11d2dcc98ad9a2c313bbe3b2962a809ed5e70b225fd5b9fa8cae295"}
Jul 23 01:34:17.252391 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:17.252070    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:17.273380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:17.273337    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk" podStartSLOduration=2.777054099 podStartE2EDuration="7.273323544s" totalImagesPullingTime="3.411979151s" totalInitContainerRuntime="1.084290294s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:34:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:34:17.271678439 +0000 UTC m=+369.020738112" watchObservedRunningTime="2026-07-23 01:34:17.273323544 +0000 UTC m=+369.022383215"
Jul 23 01:34:21.892411 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:21.892371    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:21.992267 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:21.992234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:28.258601 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:28.258571    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk"
Jul 23 01:34:29.904743 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.904698    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:29.981428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.981393    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"]
Jul 23 01:34:29.991246 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.991219    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:29.993947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.993924    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"]
Jul 23 01:34:29.994880 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.994858    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 01:34:29.995002 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.994857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 01:34:29.995227 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.995209    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 01:34:29.995325 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.995302    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-pd6hf\""
Jul 23 01:34:29.995461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.995339    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 01:34:29.995461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:29.995339    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 01:34:30.002478 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.002458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-metrics-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.002574 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.002501    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91394b0d-3ca1-40e8-83e5-f5cdca65a605-manager-config\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.002574 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.002557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmpq\" (UniqueName: \"kubernetes.io/projected/91394b0d-3ca1-40e8-83e5-f5cdca65a605-kube-api-access-8cmpq\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.002663 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.002611    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.023779 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.023754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:30.103574 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.103545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91394b0d-3ca1-40e8-83e5-f5cdca65a605-manager-config\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.103718 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.103584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmpq\" (UniqueName: \"kubernetes.io/projected/91394b0d-3ca1-40e8-83e5-f5cdca65a605-kube-api-access-8cmpq\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.103718 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.103621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.103718 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.103651    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-metrics-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.104274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.104251    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/91394b0d-3ca1-40e8-83e5-f5cdca65a605-manager-config\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.106116 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.106093    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-metrics-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.106214 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.106119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91394b0d-3ca1-40e8-83e5-f5cdca65a605-cert\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.129373 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.129353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmpq\" (UniqueName: \"kubernetes.io/projected/91394b0d-3ca1-40e8-83e5-f5cdca65a605-kube-api-access-8cmpq\") pod \"lws-controller-manager-7564d6dfb8-hcz5r\" (UID: \"91394b0d-3ca1-40e8-83e5-f5cdca65a605\") " pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.257960 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.257921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:30.300995 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.300961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:30.430912 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.430797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"]
Jul 23 01:34:30.433502 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:34:30.433477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91394b0d_3ca1_40e8_83e5_f5cdca65a605.slice/crio-5f57c388aa33f7cb3c894818b6a88a3ca3cf68c45897f4bc9be58b0b71b1aa45 WatchSource:0}: Error finding container 5f57c388aa33f7cb3c894818b6a88a3ca3cf68c45897f4bc9be58b0b71b1aa45: Status 404 returned error can't find the container with id 5f57c388aa33f7cb3c894818b6a88a3ca3cf68c45897f4bc9be58b0b71b1aa45
Jul 23 01:34:30.696191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.696158    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:30.797848 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.797810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:30.904220 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:30.904189    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:31.172411 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.172349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:31.305996 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.305950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r" event={"ID":"91394b0d-3ca1-40e8-83e5-f5cdca65a605","Type":"ContainerStarted","Data":"5f57c388aa33f7cb3c894818b6a88a3ca3cf68c45897f4bc9be58b0b71b1aa45"}
Jul 23 01:34:31.415059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.415017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:31.655830 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.655751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:31.726483 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.726449    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:31.829979 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:31.829948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:32.814542 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:32.814517    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:33.315754 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:33.315718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r" event={"ID":"91394b0d-3ca1-40e8-83e5-f5cdca65a605","Type":"ContainerStarted","Data":"7933375dc792dcb5fb063bac1b1ec192353dbf3ada51309a024865c54189cfa1"}
Jul 23 01:34:33.315930 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:33.315778    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:33.331959 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:33.331912    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r" podStartSLOduration=1.977530889 podStartE2EDuration="4.331896567s" totalImagesPullingTime="2.354365678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:34:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:34:33.330145786 +0000 UTC m=+385.079205458" watchObservedRunningTime="2026-07-23 01:34:33.331896567 +0000 UTC m=+385.080956239"
Jul 23 01:34:38.108956 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.108920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:38.208613 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.208581    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:38.682514 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.682485    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"]
Jul 23 01:34:38.685803 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.685780    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.688689 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.688667    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 01:34:38.688960 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.688936    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qp8zg\""
Jul 23 01:34:38.700699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.700680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"]
Jul 23 01:34:38.733763 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.733727    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:38.766399 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766374    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766529 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766427    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766529 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766652 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766514    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fd63db-c2df-4825-a10d-ec33b7b49993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766711 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766827 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766803    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd7wh\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-kube-api-access-qd7wh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.766947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.766901    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868205 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868105    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868205 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868205 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fd63db-c2df-4825-a10d-ec33b7b49993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868205 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868186    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868275    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd7wh\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-kube-api-access-qd7wh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868311    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868642 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868527    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868642 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868558    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868831 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868807    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868902 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868862    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.868982 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.868961    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/42fd63db-c2df-4825-a10d-ec33b7b49993-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.870320 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.870298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.870495 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.870476    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.879479 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.879460    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd7wh\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-kube-api-access-qd7wh\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.882080 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.882059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/42fd63db-c2df-4825-a10d-ec33b7b49993-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4sg29r\" (UID: \"42fd63db-c2df-4825-a10d-ec33b7b49993\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:38.961609 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.961540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:38.997229 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:38.997207    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:39.062160 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:39.062126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:39.132654 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:39.132632    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"]
Jul 23 01:34:39.135129 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:34:39.135105    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42fd63db_c2df_4825_a10d_ec33b7b49993.slice/crio-3b7e62ac43797f0cd912a4c2664254b11c4f884be130cd30f37f6cfe670e3dac WatchSource:0}: Error finding container 3b7e62ac43797f0cd912a4c2664254b11c4f884be130cd30f37f6cfe670e3dac: Status 404 returned error can't find the container with id 3b7e62ac43797f0cd912a4c2664254b11c4f884be130cd30f37f6cfe670e3dac
Jul 23 01:34:39.340403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:39.340323    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r" event={"ID":"42fd63db-c2df-4825-a10d-ec33b7b49993","Type":"ContainerStarted","Data":"3b7e62ac43797f0cd912a4c2664254b11c4f884be130cd30f37f6cfe670e3dac"}
Jul 23 01:34:41.711994 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:41.711929    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:41.792508 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:41.792468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:41.987322 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:41.987286    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:34:41.987458 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:41.987362    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:34:41.987458 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:41.987395    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:34:42.166047 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.166000    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:42.218547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.218512    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:42.354593 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.354511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r" event={"ID":"42fd63db-c2df-4825-a10d-ec33b7b49993","Type":"ContainerStarted","Data":"d1c8d1819deecceeeb9b3e40262e14318f2387ed3a4afaa1aa7d570fff28dd39"}
Jul 23 01:34:42.373896 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.373853    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r" podStartSLOduration=1.5238682350000001 podStartE2EDuration="4.373839684s" totalImagesPullingTime="2.849971449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:34:42.371927031 +0000 UTC m=+394.120986694" watchObservedRunningTime="2026-07-23 01:34:42.373839684 +0000 UTC m=+394.122899355"
Jul 23 01:34:42.959119 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.959091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:42.998133 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:42.998107    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:43.090009 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:43.089982    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:43.183430 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:43.183401    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:34:44.002123 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:44.002095    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:44.323000 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:44.322923    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7564d6dfb8-hcz5r"
Jul 23 01:34:44.362003 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:44.361976    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:34:44.363079 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:34:44.363059    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4sg29r"
Jul 23 01:35:31.421429 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.421343    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:31.523984 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.523954    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:31.555941 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.555913    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:31.567126 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.567101    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:31.567683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.567656    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:31.569896 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.569686    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 01:35:31.569896 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.569728    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 01:35:31.570749 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.570722    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bxgb4\""
Jul 23 01:35:31.607943 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.607914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:31.656954 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.656929    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4lsx\" (UniqueName: \"kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx\") pod \"kuadrant-operator-catalog-db4hk\" (UID: \"7881d892-2d08-480f-9431-9903e5fd7375\") " pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:31.758307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.758228    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4lsx\" (UniqueName: \"kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx\") pod \"kuadrant-operator-catalog-db4hk\" (UID: \"7881d892-2d08-480f-9431-9903e5fd7375\") " pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:31.765976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.765957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4lsx\" (UniqueName: \"kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx\") pod \"kuadrant-operator-catalog-db4hk\" (UID: \"7881d892-2d08-480f-9431-9903e5fd7375\") " pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:31.877173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.877146    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:31.923059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:31.923031    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:32.003329 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.003149    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:32.005968 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:35:32.005940    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7881d892_2d08_480f_9431_9903e5fd7375.slice/crio-edddbee485a62aa1b58deb04064a203ebb65ee21e4c42628459831bdea732807 WatchSource:0}: Error finding container edddbee485a62aa1b58deb04064a203ebb65ee21e4c42628459831bdea732807: Status 404 returned error can't find the container with id edddbee485a62aa1b58deb04064a203ebb65ee21e4c42628459831bdea732807
Jul 23 01:35:32.129005 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.128978    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-44mcj"]
Jul 23 01:35:32.133111 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.133095    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:32.138766 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.138742    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-44mcj"]
Jul 23 01:35:32.262559 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.262484    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzq2m\" (UniqueName: \"kubernetes.io/projected/94a48b13-3149-4221-a299-94227e7997ac-kube-api-access-pzq2m\") pod \"kuadrant-operator-catalog-44mcj\" (UID: \"94a48b13-3149-4221-a299-94227e7997ac\") " pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:32.349692 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.349661    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:32.363773 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.363749    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzq2m\" (UniqueName: \"kubernetes.io/projected/94a48b13-3149-4221-a299-94227e7997ac-kube-api-access-pzq2m\") pod \"kuadrant-operator-catalog-44mcj\" (UID: \"94a48b13-3149-4221-a299-94227e7997ac\") " pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:32.371666 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.371650    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzq2m\" (UniqueName: \"kubernetes.io/projected/94a48b13-3149-4221-a299-94227e7997ac-kube-api-access-pzq2m\") pod \"kuadrant-operator-catalog-44mcj\" (UID: \"94a48b13-3149-4221-a299-94227e7997ac\") " pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:32.442656 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.442610    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:32.549807 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.549592    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" event={"ID":"7881d892-2d08-480f-9431-9903e5fd7375","Type":"ContainerStarted","Data":"edddbee485a62aa1b58deb04064a203ebb65ee21e4c42628459831bdea732807"}
Jul 23 01:35:32.558713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.558640    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:32.577494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:32.577463    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-44mcj"]
Jul 23 01:35:32.579962 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:35:32.579938    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94a48b13_3149_4221_a299_94227e7997ac.slice/crio-db50f4e23f01b683af0c49ce223d176333139c6213aad0ae58bf847e84b273aa WatchSource:0}: Error finding container db50f4e23f01b683af0c49ce223d176333139c6213aad0ae58bf847e84b273aa: Status 404 returned error can't find the container with id db50f4e23f01b683af0c49ce223d176333139c6213aad0ae58bf847e84b273aa
Jul 23 01:35:33.557506 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:33.557471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-44mcj" event={"ID":"94a48b13-3149-4221-a299-94227e7997ac","Type":"ContainerStarted","Data":"db50f4e23f01b683af0c49ce223d176333139c6213aad0ae58bf847e84b273aa"}
Jul 23 01:35:34.563046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.563003    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" event={"ID":"7881d892-2d08-480f-9431-9903e5fd7375","Type":"ContainerStarted","Data":"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"}
Jul 23 01:35:34.563046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.563026    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" podUID="7881d892-2d08-480f-9431-9903e5fd7375" containerName="registry-server" containerID="cri-o://b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e" gracePeriod=2
Jul 23 01:35:34.570340 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.570309    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-44mcj" event={"ID":"94a48b13-3149-4221-a299-94227e7997ac","Type":"ContainerStarted","Data":"f2610aa47cd5d3d6aaf5b708f83bb1583030ac36f6dacc9752b8599df6325a9e"}
Jul 23 01:35:34.579911 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.579644    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" podStartSLOduration=1.469086231 podStartE2EDuration="3.579626779s" totalImagesPullingTime="2.110540548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:35:34.578057883 +0000 UTC m=+446.327117554" watchObservedRunningTime="2026-07-23 01:35:34.579626779 +0000 UTC m=+446.328686453"
Jul 23 01:35:34.592028 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.591992    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-44mcj" podStartSLOduration=1.052026601 podStartE2EDuration="2.591978924s" totalImagesPullingTime="1.539952323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:35:34.591068914 +0000 UTC m=+446.340128588" watchObservedRunningTime="2026-07-23 01:35:34.591978924 +0000 UTC m=+446.341038596"
Jul 23 01:35:34.799368 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.799347    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:34.889131 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.889066    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4lsx\" (UniqueName: \"kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx\") pod \"7881d892-2d08-480f-9431-9903e5fd7375\" (UID: \"7881d892-2d08-480f-9431-9903e5fd7375\") "
Jul 23 01:35:34.891171 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.891145    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx" (OuterVolumeSpecName: "kube-api-access-s4lsx") pod "7881d892-2d08-480f-9431-9903e5fd7375" (UID: "7881d892-2d08-480f-9431-9903e5fd7375"). InnerVolumeSpecName "kube-api-access-s4lsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:35:34.990359 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:34.990329    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4lsx\" (UniqueName: \"kubernetes.io/projected/7881d892-2d08-480f-9431-9903e5fd7375-kube-api-access-s4lsx\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:35:35.575643 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.575609    2572 generic.go:356] "Generic (PLEG): container finished" podID="7881d892-2d08-480f-9431-9903e5fd7375" containerID="b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e" exitCode=0
Jul 23 01:35:35.576043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.575656    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-db4hk"
Jul 23 01:35:35.576043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.575700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" event={"ID":"7881d892-2d08-480f-9431-9903e5fd7375","Type":"ContainerDied","Data":"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"}
Jul 23 01:35:35.576043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.575748    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-db4hk" event={"ID":"7881d892-2d08-480f-9431-9903e5fd7375","Type":"ContainerDied","Data":"edddbee485a62aa1b58deb04064a203ebb65ee21e4c42628459831bdea732807"}
Jul 23 01:35:35.576043 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.575768    2572 scope.go:117] "RemoveContainer" containerID="b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"
Jul 23 01:35:35.584375 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.584355    2572 scope.go:117] "RemoveContainer" containerID="b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"
Jul 23 01:35:35.584638 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:35:35.584619    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e\": container with ID starting with b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e not found: ID does not exist" containerID="b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"
Jul 23 01:35:35.584705 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.584644    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e"} err="failed to get container status \"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e\": rpc error: code = NotFound desc = could not find container \"b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e\": container with ID starting with b0fe2385407beca2546845571958feba16a767a735d878910192a2e74966580e not found: ID does not exist"
Jul 23 01:35:35.594550 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.594531    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:35.600085 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:35.600064    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-db4hk"]
Jul 23 01:35:36.747718 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:36.747689    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7881d892-2d08-480f-9431-9903e5fd7375" path="/var/lib/kubelet/pods/7881d892-2d08-480f-9431-9903e5fd7375/volumes"
Jul 23 01:35:42.443337 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:42.443303    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:42.443806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:42.443358    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:42.465948 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:42.465928    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:42.626970 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:42.626942    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-44mcj"
Jul 23 01:35:55.640371 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:55.640330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:55.696676 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:55.696638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:57.448974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:57.448935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:57.924943 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:57.924909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:58.027792 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:58.027763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:35:59.893578 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.893540    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"]
Jul 23 01:35:59.893974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.893957    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7881d892-2d08-480f-9431-9903e5fd7375" containerName="registry-server"
Jul 23 01:35:59.894020 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.893977    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7881d892-2d08-480f-9431-9903e5fd7375" containerName="registry-server"
Jul 23 01:35:59.894067 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.894056    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7881d892-2d08-480f-9431-9903e5fd7375" containerName="registry-server"
Jul 23 01:35:59.898580 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.898563    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:35:59.902031 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.902009    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 01:35:59.902257 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.902242    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-nkhks\""
Jul 23 01:35:59.907098 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.907075    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"]
Jul 23 01:35:59.976427 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:35:59.976392    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwqbj\" (UniqueName: \"kubernetes.io/projected/141e9e9d-3cb5-4b39-a051-4cfda7ec2366-kube-api-access-mwqbj\") pod \"dns-operator-controller-manager-864dd78c4c-vl6j2\" (UID: \"141e9e9d-3cb5-4b39-a051-4cfda7ec2366\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:00.076940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.076898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwqbj\" (UniqueName: \"kubernetes.io/projected/141e9e9d-3cb5-4b39-a051-4cfda7ec2366-kube-api-access-mwqbj\") pod \"dns-operator-controller-manager-864dd78c4c-vl6j2\" (UID: \"141e9e9d-3cb5-4b39-a051-4cfda7ec2366\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:00.091042 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.091007    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwqbj\" (UniqueName: \"kubernetes.io/projected/141e9e9d-3cb5-4b39-a051-4cfda7ec2366-kube-api-access-mwqbj\") pod \"dns-operator-controller-manager-864dd78c4c-vl6j2\" (UID: \"141e9e9d-3cb5-4b39-a051-4cfda7ec2366\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:00.209341 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.209308    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:00.339523 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.339383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"]
Jul 23 01:36:00.342156 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:36:00.342128    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod141e9e9d_3cb5_4b39_a051_4cfda7ec2366.slice/crio-a3eb57c266739fd9c862a37519cc1c8f6c31b9e307d5f6fd5538a796b2998a57 WatchSource:0}: Error finding container a3eb57c266739fd9c862a37519cc1c8f6c31b9e307d5f6fd5538a796b2998a57: Status 404 returned error can't find the container with id a3eb57c266739fd9c862a37519cc1c8f6c31b9e307d5f6fd5538a796b2998a57
Jul 23 01:36:00.646997 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.646907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:00.678200 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:00.678168    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2" event={"ID":"141e9e9d-3cb5-4b39-a051-4cfda7ec2366","Type":"ContainerStarted","Data":"a3eb57c266739fd9c862a37519cc1c8f6c31b9e307d5f6fd5538a796b2998a57"}
Jul 23 01:36:01.446470 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:01.446415    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:03.693160 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:03.693130    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2" event={"ID":"141e9e9d-3cb5-4b39-a051-4cfda7ec2366","Type":"ContainerStarted","Data":"da84cc51463c07f55c7968f876d8f237ca2c095f23fe3af749faab7ea2e3bcb1"}
Jul 23 01:36:03.693604 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:03.693244    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:03.709856 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:03.709809    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2" podStartSLOduration=2.387430995 podStartE2EDuration="4.70979197s" totalImagesPullingTime="2.322360975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:36:03.709288652 +0000 UTC m=+475.458348325" watchObservedRunningTime="2026-07-23 01:36:03.70979197 +0000 UTC m=+475.458851645"
Jul 23 01:36:04.183513 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.183480    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"]
Jul 23 01:36:04.189806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.189786    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:04.192137 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.192119    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6krsg\""
Jul 23 01:36:04.196112 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.196092    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"]
Jul 23 01:36:04.211135 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.211114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sncp\" (UniqueName: \"kubernetes.io/projected/e3b20c63-da6d-44cc-99eb-dc5dcb454724-kube-api-access-4sncp\") pod \"authorino-operator-75cc8d5cb7-59f5l\" (UID: \"e3b20c63-da6d-44cc-99eb-dc5dcb454724\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:04.312208 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.312178    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sncp\" (UniqueName: \"kubernetes.io/projected/e3b20c63-da6d-44cc-99eb-dc5dcb454724-kube-api-access-4sncp\") pod \"authorino-operator-75cc8d5cb7-59f5l\" (UID: \"e3b20c63-da6d-44cc-99eb-dc5dcb454724\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:04.325609 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.325585    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sncp\" (UniqueName: \"kubernetes.io/projected/e3b20c63-da6d-44cc-99eb-dc5dcb454724-kube-api-access-4sncp\") pod \"authorino-operator-75cc8d5cb7-59f5l\" (UID: \"e3b20c63-da6d-44cc-99eb-dc5dcb454724\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:04.501124 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.501050    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:04.631895 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.631872    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"]
Jul 23 01:36:04.634210 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:36:04.634179    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b20c63_da6d_44cc_99eb_dc5dcb454724.slice/crio-90f038bb6c5acfb121b9590329484e1364f5efc9b008dd10491fd1b6507f8a5d WatchSource:0}: Error finding container 90f038bb6c5acfb121b9590329484e1364f5efc9b008dd10491fd1b6507f8a5d: Status 404 returned error can't find the container with id 90f038bb6c5acfb121b9590329484e1364f5efc9b008dd10491fd1b6507f8a5d
Jul 23 01:36:04.697848 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:04.697818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l" event={"ID":"e3b20c63-da6d-44cc-99eb-dc5dcb454724","Type":"ContainerStarted","Data":"90f038bb6c5acfb121b9590329484e1364f5efc9b008dd10491fd1b6507f8a5d"}
Jul 23 01:36:05.252959 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:05.252921    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:05.701745 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:05.701691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:07.394397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.394359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:07.488461 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.488404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:07.593144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.593101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:07.714108 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.714072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l" event={"ID":"e3b20c63-da6d-44cc-99eb-dc5dcb454724","Type":"ContainerStarted","Data":"7a8bd059569bde300edc96c517496da21ab49fed77a4f17694f80cbb9cf89b8a"}
Jul 23 01:36:07.714316 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.714175    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:07.733265 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:07.733212    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l" podStartSLOduration=1.465070292 podStartE2EDuration="3.733195103s" totalImagesPullingTime="2.268124811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:36:07.731735413 +0000 UTC m=+479.480795095" watchObservedRunningTime="2026-07-23 01:36:07.733195103 +0000 UTC m=+479.482254775"
Jul 23 01:36:08.045971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:08.045886    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:09.111019 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:09.110922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:09.312407 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:09.312310    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:09.413206 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:09.413173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:09.513237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:09.513203    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:09.613318 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:09.613287    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:10.879159 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:10.879114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:13.463931 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:13.463894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:13.563793 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:13.563752    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:14.700650 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:14.700619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vl6j2"
Jul 23 01:36:18.720488 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:18.720456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-59f5l"
Jul 23 01:36:19.056731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:19.056644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:19.161244 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:19.161207    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:19.472388 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:19.472354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:19.573302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:19.573267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:20.886577 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.886547    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"]
Jul 23 01:36:20.891884 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.891860    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:20.892170 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.892131    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:20.895097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.895075    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 01:36:20.895429 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.895413    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-x2gdz\""
Jul 23 01:36:20.895537 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.895517    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 01:36:20.905591 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.905571    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"]
Jul 23 01:36:20.943138 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.943110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8zx\" (UniqueName: \"kubernetes.io/projected/834231a5-8607-444d-a1b7-7285c04b3b55-kube-api-access-vr8zx\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:20.943275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.943157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/834231a5-8607-444d-a1b7-7285c04b3b55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:20.943275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:20.943209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.043732 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.043704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/834231a5-8607-444d-a1b7-7285c04b3b55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.043897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.043752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.043897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.043811    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8zx\" (UniqueName: \"kubernetes.io/projected/834231a5-8607-444d-a1b7-7285c04b3b55-kube-api-access-vr8zx\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.044008 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:36:21.043928    2572 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 23 01:36:21.044008 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:36:21.044001    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert podName:834231a5-8607-444d-a1b7-7285c04b3b55 nodeName:}" failed. No retries permitted until 2026-07-23 01:36:21.543981944 +0000 UTC m=+493.293041594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-qzsw7" (UID: "834231a5-8607-444d-a1b7-7285c04b3b55") : secret "plugin-serving-cert" not found
Jul 23 01:36:21.044677 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.044653    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/834231a5-8607-444d-a1b7-7285c04b3b55-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.052285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.052255    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8zx\" (UniqueName: \"kubernetes.io/projected/834231a5-8607-444d-a1b7-7285c04b3b55-kube-api-access-vr8zx\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.301695 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.301659    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:21.548275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.548247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.550616 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.550598    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/834231a5-8607-444d-a1b7-7285c04b3b55-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qzsw7\" (UID: \"834231a5-8607-444d-a1b7-7285c04b3b55\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.801351 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.801324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"
Jul 23 01:36:21.925749 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:21.925724    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7"]
Jul 23 01:36:21.928064 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:36:21.928040    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod834231a5_8607_444d_a1b7_7285c04b3b55.slice/crio-a86f540dfe160c6a197503b2365f704196ac407701ccd7dc18a2e6fc190cd4b6 WatchSource:0}: Error finding container a86f540dfe160c6a197503b2365f704196ac407701ccd7dc18a2e6fc190cd4b6: Status 404 returned error can't find the container with id a86f540dfe160c6a197503b2365f704196ac407701ccd7dc18a2e6fc190cd4b6
Jul 23 01:36:22.783235 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:22.783175    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7" event={"ID":"834231a5-8607-444d-a1b7-7285c04b3b55","Type":"ContainerStarted","Data":"a86f540dfe160c6a197503b2365f704196ac407701ccd7dc18a2e6fc190cd4b6"}
Jul 23 01:36:23.246041 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:23.245990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:23.348286 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:23.348250    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:25.165842 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:25.165793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:25.388112 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:25.388079    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:25.488771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:25.488643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:32.048960 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:32.048920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:32.127296 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:32.127151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:37.418090 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:37.418058    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:37.476953 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:37.476920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:37.815728 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:37.815638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:37.924824 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:37.924781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:40.150177 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:40.150136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:40.252995 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:40.252959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:40.376810 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:40.376772    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:41.268545 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:41.268497    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:41.359808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:41.359668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:43.794148 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:43.794096    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:43.888882 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:43.888848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:44.888254 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:44.888211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7" event={"ID":"834231a5-8607-444d-a1b7-7285c04b3b55","Type":"ContainerStarted","Data":"b9ea488603bee5c0a43e4802e859eaf8539c577dd6dcc5629f6629ed3a7ea741"}
Jul 23 01:36:44.904071 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:44.904025    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qzsw7" podStartSLOduration=2.550718487 podStartE2EDuration="24.904011178s" totalImagesPullingTime="22.353292691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:36:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:36:44.90383886 +0000 UTC m=+516.652898533" watchObservedRunningTime="2026-07-23 01:36:44.904011178 +0000 UTC m=+516.653070846"
Jul 23 01:36:50.132894 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:50.132860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:36:50.232649 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:36:50.232612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:00.401154 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.401123    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"]
Jul 23 01:37:00.410643 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.410620    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.413010 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.412983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dw2td\""
Jul 23 01:37:00.413626 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.413606    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"]
Jul 23 01:37:00.422079 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.422055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:00.579968 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.579936    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.579974    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580059    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580155    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580177    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdm9s\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-kube-api-access-cdm9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580401 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580258    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.580401 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.580287    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681518 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681676 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681561    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681676 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681587    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681676 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681620    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681779 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681828 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681805    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdm9s\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-kube-api-access-cdm9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681864 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.681967 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.681923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.682089 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.682060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.682200 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.682180    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.682283 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.682258    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.682397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.682375    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.682475 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.682422    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.683868 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.683850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.684313 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.684295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.690096 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.690067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdm9s\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-kube-api-access-cdm9s\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.691079 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.691055    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d53130c-ace9-4fdc-9c66-7e5d060670e5-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-rwx9n\" (UID: \"2d53130c-ace9-4fdc-9c66-7e5d060670e5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.721564 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.721535    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:00.809225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.809173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:00.855484 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.855462    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"]
Jul 23 01:37:00.857327 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:00.857294    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d53130c_ace9_4fdc_9c66_7e5d060670e5.slice/crio-d0ce0dbb73d5030579efb0beb54c4f357388b846e93f2d9c3e59c8aa3b5b2aba WatchSource:0}: Error finding container d0ce0dbb73d5030579efb0beb54c4f357388b846e93f2d9c3e59c8aa3b5b2aba: Status 404 returned error can't find the container with id d0ce0dbb73d5030579efb0beb54c4f357388b846e93f2d9c3e59c8aa3b5b2aba
Jul 23 01:37:00.859559 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.859529    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:37:00.859632 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.859595    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:37:00.859632 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.859622    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:37:00.954203 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.954113    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" event={"ID":"2d53130c-ace9-4fdc-9c66-7e5d060670e5","Type":"ContainerStarted","Data":"75680a12ac5d834ac43c840f7e65da1b4248dad710f7bffd96ddd1e1ea78fd6c"}
Jul 23 01:37:00.954203 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.954172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" event={"ID":"2d53130c-ace9-4fdc-9c66-7e5d060670e5","Type":"ContainerStarted","Data":"d0ce0dbb73d5030579efb0beb54c4f357388b846e93f2d9c3e59c8aa3b5b2aba"}
Jul 23 01:37:00.974625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:00.974564    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" podStartSLOduration=0.974547841 podStartE2EDuration="974.547841ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:00.971229555 +0000 UTC m=+532.720289226" watchObservedRunningTime="2026-07-23 01:37:00.974547841 +0000 UTC m=+532.723607512"
Jul 23 01:37:01.722218 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:01.722171    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:01.727217 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:01.727193    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:01.960534 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:01.960502    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:01.961341 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:01.961320    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:37:16.423067 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:16.423027    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:16.534402 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:16.534370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:16.635731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:16.635696    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:17.235447 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.235403    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:17.259312 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.259266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:17.263251 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.263229    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:17.263353 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.263310    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:17.265686 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.265668    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-chtxp\""
Jul 23 01:37:17.299999 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.299978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spckh\" (UniqueName: \"kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh\") pod \"authorino-58cd955675-k4j57\" (UID: \"5fd65114-4a6f-4c79-aed0-3d4878f6b368\") " pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:17.359685 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.359639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:17.400181 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.400153    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:17.400551 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.400525    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spckh\" (UniqueName: \"kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh\") pod \"authorino-58cd955675-k4j57\" (UID: \"5fd65114-4a6f-4c79-aed0-3d4878f6b368\") " pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:17.403225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.403207    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:17.413027 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.413006    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:17.414985 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.414964    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spckh\" (UniqueName: \"kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh\") pod \"authorino-58cd955675-k4j57\" (UID: \"5fd65114-4a6f-4c79-aed0-3d4878f6b368\") " pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:17.501705 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.501632    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kdd\" (UniqueName: \"kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd\") pod \"authorino-75d556bd77-hhg2b\" (UID: \"74dcf8bb-530f-485e-ad6d-add04ac1f462\") " pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:17.572046 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.572025    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:17.602089 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.602060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kdd\" (UniqueName: \"kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd\") pod \"authorino-75d556bd77-hhg2b\" (UID: \"74dcf8bb-530f-485e-ad6d-add04ac1f462\") " pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:17.610161 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.610134    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kdd\" (UniqueName: \"kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd\") pod \"authorino-75d556bd77-hhg2b\" (UID: \"74dcf8bb-530f-485e-ad6d-add04ac1f462\") " pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:17.695083 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.695051    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:17.698023 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:17.697997    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fd65114_4a6f_4c79_aed0_3d4878f6b368.slice/crio-1ab096110d4991b602880443a468f670e2c49aa1f72176432a5f329efb73f9c8 WatchSource:0}: Error finding container 1ab096110d4991b602880443a468f670e2c49aa1f72176432a5f329efb73f9c8: Status 404 returned error can't find the container with id 1ab096110d4991b602880443a468f670e2c49aa1f72176432a5f329efb73f9c8
Jul 23 01:37:17.711854 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.711831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:17.832563 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:17.832533    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:17.835238 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:17.835213    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74dcf8bb_530f_485e_ad6d_add04ac1f462.slice/crio-17607989d85a5d4777a94b3e74949a52ca0ad76c9da22e49d45a1214b00f8ea4 WatchSource:0}: Error finding container 17607989d85a5d4777a94b3e74949a52ca0ad76c9da22e49d45a1214b00f8ea4: Status 404 returned error can't find the container with id 17607989d85a5d4777a94b3e74949a52ca0ad76c9da22e49d45a1214b00f8ea4
Jul 23 01:37:18.027638 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:18.027568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hhg2b" event={"ID":"74dcf8bb-530f-485e-ad6d-add04ac1f462","Type":"ContainerStarted","Data":"17607989d85a5d4777a94b3e74949a52ca0ad76c9da22e49d45a1214b00f8ea4"}
Jul 23 01:37:18.028593 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:18.028568    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k4j57" event={"ID":"5fd65114-4a6f-4c79-aed0-3d4878f6b368","Type":"ContainerStarted","Data":"1ab096110d4991b602880443a468f670e2c49aa1f72176432a5f329efb73f9c8"}
Jul 23 01:37:22.053379 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:22.053331    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hhg2b" event={"ID":"74dcf8bb-530f-485e-ad6d-add04ac1f462","Type":"ContainerStarted","Data":"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"}
Jul 23 01:37:22.054996 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:22.054971    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k4j57" event={"ID":"5fd65114-4a6f-4c79-aed0-3d4878f6b368","Type":"ContainerStarted","Data":"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"}
Jul 23 01:37:22.067672 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:22.067628    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hhg2b" podStartSLOduration=1.5564137260000002 podStartE2EDuration="5.067615037s" totalImagesPullingTime="3.511201311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:22.066876099 +0000 UTC m=+553.815935773" watchObservedRunningTime="2026-07-23 01:37:22.067615037 +0000 UTC m=+553.816674778"
Jul 23 01:37:22.079699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:22.079654    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-k4j57" podStartSLOduration=1.441764123 podStartE2EDuration="5.079640171s" totalImagesPullingTime="3.637876048s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:22.078923797 +0000 UTC m=+553.827983472" watchObservedRunningTime="2026-07-23 01:37:22.079640171 +0000 UTC m=+553.828699877"
Jul 23 01:37:22.103512 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:22.103484    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:24.063854 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:24.063815    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-k4j57" podUID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" containerName="authorino" containerID="cri-o://1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6" gracePeriod=30
Jul 23 01:37:24.312860 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:24.312835    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:24.360599 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:24.360532    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spckh\" (UniqueName: \"kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh\") pod \"5fd65114-4a6f-4c79-aed0-3d4878f6b368\" (UID: \"5fd65114-4a6f-4c79-aed0-3d4878f6b368\") "
Jul 23 01:37:24.362547 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:24.362527    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh" (OuterVolumeSpecName: "kube-api-access-spckh") pod "5fd65114-4a6f-4c79-aed0-3d4878f6b368" (UID: "5fd65114-4a6f-4c79-aed0-3d4878f6b368"). InnerVolumeSpecName "kube-api-access-spckh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:37:24.461662 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:24.461633    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spckh\" (UniqueName: \"kubernetes.io/projected/5fd65114-4a6f-4c79-aed0-3d4878f6b368-kube-api-access-spckh\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:37:25.069462 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.069356    2572 generic.go:356] "Generic (PLEG): container finished" podID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" containerID="1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6" exitCode=0
Jul 23 01:37:25.069462 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.069420    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-k4j57"
Jul 23 01:37:25.069462 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.069452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k4j57" event={"ID":"5fd65114-4a6f-4c79-aed0-3d4878f6b368","Type":"ContainerDied","Data":"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"}
Jul 23 01:37:25.069905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.069492    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-k4j57" event={"ID":"5fd65114-4a6f-4c79-aed0-3d4878f6b368","Type":"ContainerDied","Data":"1ab096110d4991b602880443a468f670e2c49aa1f72176432a5f329efb73f9c8"}
Jul 23 01:37:25.069905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.069512    2572 scope.go:117] "RemoveContainer" containerID="1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"
Jul 23 01:37:25.077473 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.077455    2572 scope.go:117] "RemoveContainer" containerID="1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"
Jul 23 01:37:25.077701 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:25.077684    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6\": container with ID starting with 1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6 not found: ID does not exist" containerID="1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"
Jul 23 01:37:25.077753 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.077709    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6"} err="failed to get container status \"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6\": rpc error: code = NotFound desc = could not find container \"1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6\": container with ID starting with 1c47b3c88e7efcac6c1b718606a485965c513a2e4bc9d7a9dd693b1d9a8debe6 not found: ID does not exist"
Jul 23 01:37:25.083980 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.083958    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:25.086160 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:25.086143    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-k4j57"]
Jul 23 01:37:26.748073 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:26.748040    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" path="/var/lib/kubelet/pods/5fd65114-4a6f-4c79-aed0-3d4878f6b368/volumes"
Jul 23 01:37:31.909037 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:31.908946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:33.449456 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:33.449408    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:33.580232 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:33.580196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:33.896128 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:33.896044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:46.965284 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:46.965253    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:47.174667 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.174637    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:47.174973 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.174957    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" containerName="authorino"
Jul 23 01:37:47.174973 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.174973    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" containerName="authorino"
Jul 23 01:37:47.175121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.175045    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fd65114-4a6f-4c79-aed0-3d4878f6b368" containerName="authorino"
Jul 23 01:37:47.178048 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.178030    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:47.183312 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.183289    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:47.247581 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.247558    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qp2r\" (UniqueName: \"kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r\") pod \"authorino-5d4b67c446-r644b\" (UID: \"96383751-d231-412f-8f8d-906f2d367596\") " pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:47.348661 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.348629    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qp2r\" (UniqueName: \"kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r\") pod \"authorino-5d4b67c446-r644b\" (UID: \"96383751-d231-412f-8f8d-906f2d367596\") " pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:47.357089 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.357061    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qp2r\" (UniqueName: \"kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r\") pod \"authorino-5d4b67c446-r644b\" (UID: \"96383751-d231-412f-8f8d-906f2d367596\") " pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:47.407252 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.407217    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:47.407503 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.407487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:47.428774 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.428722    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:47.431971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.431955    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:47.440576 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.440556    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:47.496950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.496916    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:47.534391 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.534365    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:47.537615 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:47.537583    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96383751_d231_412f_8f8d_906f2d367596.slice/crio-720a5542b86fd870b74b43b6f3841e6593f508090531fb3e54a5adc8bcd2d29d WatchSource:0}: Error finding container 720a5542b86fd870b74b43b6f3841e6593f508090531fb3e54a5adc8bcd2d29d: Status 404 returned error can't find the container with id 720a5542b86fd870b74b43b6f3841e6593f508090531fb3e54a5adc8bcd2d29d
Jul 23 01:37:47.550581 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.550551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85hw7\" (UniqueName: \"kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7\") pod \"authorino-84b79df49-8mxtd\" (UID: \"a4f49234-02c2-45b1-86c6-418f25a14a44\") " pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:47.651271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.651243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85hw7\" (UniqueName: \"kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7\") pod \"authorino-84b79df49-8mxtd\" (UID: \"a4f49234-02c2-45b1-86c6-418f25a14a44\") " pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:47.659155 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.659135    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85hw7\" (UniqueName: \"kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7\") pod \"authorino-84b79df49-8mxtd\" (UID: \"a4f49234-02c2-45b1-86c6-418f25a14a44\") " pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:47.741303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.741252    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:47.863736 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:47.863714    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:47.865947 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:47.865922    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4f49234_02c2_45b1_86c6_418f25a14a44.slice/crio-4fe89b507cf598a5005bec543ffa7c8e137bcf7a9537850958d2332a546e46f9 WatchSource:0}: Error finding container 4fe89b507cf598a5005bec543ffa7c8e137bcf7a9537850958d2332a546e46f9: Status 404 returned error can't find the container with id 4fe89b507cf598a5005bec543ffa7c8e137bcf7a9537850958d2332a546e46f9
Jul 23 01:37:48.020087 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.020062    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:48.041781 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.041759    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:37:48.046071 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.046053    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.048104 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.048086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 01:37:48.052633 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.052572    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:37:48.154836 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.154799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.154836 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.154840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69gdt\" (UniqueName: \"kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.166380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.166349    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b79df49-8mxtd" event={"ID":"a4f49234-02c2-45b1-86c6-418f25a14a44","Type":"ContainerStarted","Data":"4fe89b507cf598a5005bec543ffa7c8e137bcf7a9537850958d2332a546e46f9"}
Jul 23 01:37:48.167708 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.167682    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r644b" event={"ID":"96383751-d231-412f-8f8d-906f2d367596","Type":"ContainerStarted","Data":"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"}
Jul 23 01:37:48.167810 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.167716    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r644b" event={"ID":"96383751-d231-412f-8f8d-906f2d367596","Type":"ContainerStarted","Data":"720a5542b86fd870b74b43b6f3841e6593f508090531fb3e54a5adc8bcd2d29d"}
Jul 23 01:37:48.167810 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.167756    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-r644b" podUID="96383751-d231-412f-8f8d-906f2d367596" containerName="authorino" containerID="cri-o://f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1" gracePeriod=30
Jul 23 01:37:48.180619 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.180580    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-r644b" podStartSLOduration=0.706643384 podStartE2EDuration="1.18056591s" totalImagesPullingTime="473.922526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:48.180167919 +0000 UTC m=+579.929227591" watchObservedRunningTime="2026-07-23 01:37:48.18056591 +0000 UTC m=+579.929625582"
Jul 23 01:37:48.255531 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.255507    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.255638 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.255541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69gdt\" (UniqueName: \"kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.257971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.257947    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.262978 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.262932    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69gdt\" (UniqueName: \"kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt\") pod \"authorino-68d6474745-9gwxw\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") " pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.358334 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.358306    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:37:48.428426 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.428401    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:48.507794 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.507765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:37:48.510753 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:48.510725    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3670490_7fc7_40be_83c6_cd6923a9d498.slice/crio-9b60fd1ab137b014995538cf803bb72b4ee43e1470d93aab0618559c8ef9b59a WatchSource:0}: Error finding container 9b60fd1ab137b014995538cf803bb72b4ee43e1470d93aab0618559c8ef9b59a: Status 404 returned error can't find the container with id 9b60fd1ab137b014995538cf803bb72b4ee43e1470d93aab0618559c8ef9b59a
Jul 23 01:37:48.557358 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.557336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qp2r\" (UniqueName: \"kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r\") pod \"96383751-d231-412f-8f8d-906f2d367596\" (UID: \"96383751-d231-412f-8f8d-906f2d367596\") "
Jul 23 01:37:48.559311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.559289    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r" (OuterVolumeSpecName: "kube-api-access-6qp2r") pod "96383751-d231-412f-8f8d-906f2d367596" (UID: "96383751-d231-412f-8f8d-906f2d367596"). InnerVolumeSpecName "kube-api-access-6qp2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:37:48.658298 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:48.658270    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qp2r\" (UniqueName: \"kubernetes.io/projected/96383751-d231-412f-8f8d-906f2d367596-kube-api-access-6qp2r\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:37:49.173198 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.173161    2572 generic.go:356] "Generic (PLEG): container finished" podID="96383751-d231-412f-8f8d-906f2d367596" containerID="f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1" exitCode=0
Jul 23 01:37:49.173629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.173221    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-r644b"
Jul 23 01:37:49.173629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.173245    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r644b" event={"ID":"96383751-d231-412f-8f8d-906f2d367596","Type":"ContainerDied","Data":"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"}
Jul 23 01:37:49.173629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.173284    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-r644b" event={"ID":"96383751-d231-412f-8f8d-906f2d367596","Type":"ContainerDied","Data":"720a5542b86fd870b74b43b6f3841e6593f508090531fb3e54a5adc8bcd2d29d"}
Jul 23 01:37:49.173629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.173306    2572 scope.go:117] "RemoveContainer" containerID="f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"
Jul 23 01:37:49.174931 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.174894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d6474745-9gwxw" event={"ID":"a3670490-7fc7-40be-83c6-cd6923a9d498","Type":"ContainerStarted","Data":"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"}
Jul 23 01:37:49.175060 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.174940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d6474745-9gwxw" event={"ID":"a3670490-7fc7-40be-83c6-cd6923a9d498","Type":"ContainerStarted","Data":"9b60fd1ab137b014995538cf803bb72b4ee43e1470d93aab0618559c8ef9b59a"}
Jul 23 01:37:49.177092 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.177071    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b79df49-8mxtd" event={"ID":"a4f49234-02c2-45b1-86c6-418f25a14a44","Type":"ContainerStarted","Data":"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"}
Jul 23 01:37:49.177194 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.177151    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-84b79df49-8mxtd" podUID="a4f49234-02c2-45b1-86c6-418f25a14a44" containerName="authorino" containerID="cri-o://6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726" gracePeriod=30
Jul 23 01:37:49.182282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.182268    2572 scope.go:117] "RemoveContainer" containerID="f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"
Jul 23 01:37:49.182548 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:49.182530    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1\": container with ID starting with f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1 not found: ID does not exist" containerID="f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"
Jul 23 01:37:49.182608 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.182556    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1"} err="failed to get container status \"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1\": rpc error: code = NotFound desc = could not find container \"f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1\": container with ID starting with f28cd638b191783883f44b3ccb8670a2101a7699d6e99f41434538609808b0e1 not found: ID does not exist"
Jul 23 01:37:49.190236 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.190200    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68d6474745-9gwxw" podStartSLOduration=0.71882049 podStartE2EDuration="1.190189819s" totalImagesPullingTime="471.369329ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:49.189276467 +0000 UTC m=+580.938336140" watchObservedRunningTime="2026-07-23 01:37:49.190189819 +0000 UTC m=+580.939249491"
Jul 23 01:37:49.204609 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.204586    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:49.207030 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.207008    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-r644b"]
Jul 23 01:37:49.212020 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.212000    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:49.212195 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.212175    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hhg2b" podUID="74dcf8bb-530f-485e-ad6d-add04ac1f462" containerName="authorino" containerID="cri-o://bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee" gracePeriod=30
Jul 23 01:37:49.219552 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.219494    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84b79df49-8mxtd" podStartSLOduration=1.761203404 podStartE2EDuration="2.219476399s" totalImagesPullingTime="458.272995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:49.217618814 +0000 UTC m=+580.966678488" watchObservedRunningTime="2026-07-23 01:37:49.219476399 +0000 UTC m=+580.968536071"
Jul 23 01:37:49.479225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.479206    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:49.481888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.481869    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:49.564736 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.564709    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85hw7\" (UniqueName: \"kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7\") pod \"a4f49234-02c2-45b1-86c6-418f25a14a44\" (UID: \"a4f49234-02c2-45b1-86c6-418f25a14a44\") "
Jul 23 01:37:49.564897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.564767    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8kdd\" (UniqueName: \"kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd\") pod \"74dcf8bb-530f-485e-ad6d-add04ac1f462\" (UID: \"74dcf8bb-530f-485e-ad6d-add04ac1f462\") "
Jul 23 01:37:49.566837 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.566809    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7" (OuterVolumeSpecName: "kube-api-access-85hw7") pod "a4f49234-02c2-45b1-86c6-418f25a14a44" (UID: "a4f49234-02c2-45b1-86c6-418f25a14a44"). InnerVolumeSpecName "kube-api-access-85hw7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:37:49.566957 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.566857    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd" (OuterVolumeSpecName: "kube-api-access-m8kdd") pod "74dcf8bb-530f-485e-ad6d-add04ac1f462" (UID: "74dcf8bb-530f-485e-ad6d-add04ac1f462"). InnerVolumeSpecName "kube-api-access-m8kdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:37:49.666290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.666265    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85hw7\" (UniqueName: \"kubernetes.io/projected/a4f49234-02c2-45b1-86c6-418f25a14a44-kube-api-access-85hw7\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:37:49.666290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:49.666287    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8kdd\" (UniqueName: \"kubernetes.io/projected/74dcf8bb-530f-485e-ad6d-add04ac1f462-kube-api-access-m8kdd\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:37:50.182493 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.182461    2572 generic.go:356] "Generic (PLEG): container finished" podID="74dcf8bb-530f-485e-ad6d-add04ac1f462" containerID="bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee" exitCode=0
Jul 23 01:37:50.182940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.182500    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hhg2b"
Jul 23 01:37:50.182940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.182543    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hhg2b" event={"ID":"74dcf8bb-530f-485e-ad6d-add04ac1f462","Type":"ContainerDied","Data":"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"}
Jul 23 01:37:50.182940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.182588    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hhg2b" event={"ID":"74dcf8bb-530f-485e-ad6d-add04ac1f462","Type":"ContainerDied","Data":"17607989d85a5d4777a94b3e74949a52ca0ad76c9da22e49d45a1214b00f8ea4"}
Jul 23 01:37:50.182940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.182613    2572 scope.go:117] "RemoveContainer" containerID="bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"
Jul 23 01:37:50.183828 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.183809    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4f49234-02c2-45b1-86c6-418f25a14a44" containerID="6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726" exitCode=0
Jul 23 01:37:50.183904 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.183868    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84b79df49-8mxtd"
Jul 23 01:37:50.183969 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.183910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b79df49-8mxtd" event={"ID":"a4f49234-02c2-45b1-86c6-418f25a14a44","Type":"ContainerDied","Data":"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"}
Jul 23 01:37:50.183969 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.183947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84b79df49-8mxtd" event={"ID":"a4f49234-02c2-45b1-86c6-418f25a14a44","Type":"ContainerDied","Data":"4fe89b507cf598a5005bec543ffa7c8e137bcf7a9537850958d2332a546e46f9"}
Jul 23 01:37:50.191928 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.191908    2572 scope.go:117] "RemoveContainer" containerID="bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"
Jul 23 01:37:50.192175 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:50.192158    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee\": container with ID starting with bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee not found: ID does not exist" containerID="bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"
Jul 23 01:37:50.192239 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.192182    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee"} err="failed to get container status \"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee\": rpc error: code = NotFound desc = could not find container \"bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee\": container with ID starting with bfcd76db3e8b79d52df09f3f1bdeeaad29759274fc538bf2cbc66c92048094ee not found: ID does not exist"
Jul 23 01:37:50.192239 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.192198    2572 scope.go:117] "RemoveContainer" containerID="6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"
Jul 23 01:37:50.199764 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.199744    2572 scope.go:117] "RemoveContainer" containerID="6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"
Jul 23 01:37:50.200007 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:50.199987    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726\": container with ID starting with 6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726 not found: ID does not exist" containerID="6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"
Jul 23 01:37:50.200069 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.200020    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726"} err="failed to get container status \"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726\": rpc error: code = NotFound desc = could not find container \"6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726\": container with ID starting with 6896dffdf04b4730f8487aa6fc5a005428957439f48a964cd9e80c19bab8b726 not found: ID does not exist"
Jul 23 01:37:50.203161 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.203141    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:50.206932 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.206906    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hhg2b"]
Jul 23 01:37:50.215503 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.215483    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:50.218883 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.218862    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84b79df49-8mxtd"]
Jul 23 01:37:50.748803 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.748772    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74dcf8bb-530f-485e-ad6d-add04ac1f462" path="/var/lib/kubelet/pods/74dcf8bb-530f-485e-ad6d-add04ac1f462/volumes"
Jul 23 01:37:50.749082 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.749070    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96383751-d231-412f-8f8d-906f2d367596" path="/var/lib/kubelet/pods/96383751-d231-412f-8f8d-906f2d367596/volumes"
Jul 23 01:37:50.749343 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:50.749332    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f49234-02c2-45b1-86c6-418f25a14a44" path="/var/lib/kubelet/pods/a4f49234-02c2-45b1-86c6-418f25a14a44/volumes"
Jul 23 01:37:53.889378 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.889342    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:53.901977 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.901949    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:37:53.902255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902243    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74dcf8bb-530f-485e-ad6d-add04ac1f462" containerName="authorino"
Jul 23 01:37:53.902302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902256    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="74dcf8bb-530f-485e-ad6d-add04ac1f462" containerName="authorino"
Jul 23 01:37:53.902302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902268    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96383751-d231-412f-8f8d-906f2d367596" containerName="authorino"
Jul 23 01:37:53.902302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902274    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="96383751-d231-412f-8f8d-906f2d367596" containerName="authorino"
Jul 23 01:37:53.902302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902292    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f49234-02c2-45b1-86c6-418f25a14a44" containerName="authorino"
Jul 23 01:37:53.902302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902298    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f49234-02c2-45b1-86c6-418f25a14a44" containerName="authorino"
Jul 23 01:37:53.902464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902347    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="96383751-d231-412f-8f8d-906f2d367596" containerName="authorino"
Jul 23 01:37:53.902464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902353    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f49234-02c2-45b1-86c6-418f25a14a44" containerName="authorino"
Jul 23 01:37:53.902464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.902361    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="74dcf8bb-530f-485e-ad6d-add04ac1f462" containerName="authorino"
Jul 23 01:37:53.908688 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.908669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:53.910971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.910948    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 01:37:53.911085 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.910974    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 01:37:53.911085 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.911012    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-4hpt5\""
Jul 23 01:37:53.914261 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.914234    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:37:53.971402 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:53.971373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:54.002530 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.002503    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db5xr\" (UniqueName: \"kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.002678 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.002553    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.028994 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.028970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:54.103528 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.103496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db5xr\" (UniqueName: \"kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.103679 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.103547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.103679 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:54.103656    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 23 01:37:54.103769 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:37:54.103715    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert podName:5f00666e-b0c6-4ba0-aaa9-9180c7e2f181 nodeName:}" failed. No retries permitted until 2026-07-23 01:37:54.603698074 +0000 UTC m=+586.352757727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert") pod "maas-controller-684bd45b87-kf6jc" (UID: "5f00666e-b0c6-4ba0-aaa9-9180c7e2f181") : secret "maas-controller-webhook-cert" not found
Jul 23 01:37:54.113343 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.113265    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db5xr\" (UniqueName: \"kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.188228 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.188199    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:54.607588 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.607515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.609791 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.609768    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") pod \"maas-controller-684bd45b87-kf6jc\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") " pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.820939 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.820903    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:54.947793 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:54.947770    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:37:54.949889 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:37:54.949866    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f00666e_b0c6_4ba0_aaa9_9180c7e2f181.slice/crio-d4221d6967883e3b71149fce932dabaaa75c6b117f7080c4d6f0147474adda63 WatchSource:0}: Error finding container d4221d6967883e3b71149fce932dabaaa75c6b117f7080c4d6f0147474adda63: Status 404 returned error can't find the container with id d4221d6967883e3b71149fce932dabaaa75c6b117f7080c4d6f0147474adda63
Jul 23 01:37:55.210224 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:55.210191    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684bd45b87-kf6jc" event={"ID":"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181","Type":"ContainerStarted","Data":"d4221d6967883e3b71149fce932dabaaa75c6b117f7080c4d6f0147474adda63"}
Jul 23 01:37:57.177061 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:57.177034    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:37:57.223537 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:57.223511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684bd45b87-kf6jc" event={"ID":"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181","Type":"ContainerStarted","Data":"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"}
Jul 23 01:37:57.223682 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:57.223619    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:37:57.246784 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:57.243481    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-684bd45b87-kf6jc" podStartSLOduration=2.073243288 podStartE2EDuration="4.243462114s" totalImagesPullingTime="2.170218826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:37:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:37:57.240331181 +0000 UTC m=+588.989390878" watchObservedRunningTime="2026-07-23 01:37:57.243462114 +0000 UTC m=+588.992521787"
Jul 23 01:37:57.253185 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:37:57.253158    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:08.229979 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:08.229951    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:38:08.709241 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:08.709216    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:38:08.713966 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:08.713946    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:38:08.751294 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:08.751270    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:38:08.751470 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:08.751417    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-684bd45b87-kf6jc" podUID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" containerName="manager" containerID="cri-o://8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18" gracePeriod=30
Jul 23 01:38:09.012978 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.012953    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:38:09.032482 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.032426    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") pod \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") "
Jul 23 01:38:09.032598 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.032561    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db5xr\" (UniqueName: \"kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr\") pod \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\" (UID: \"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181\") "
Jul 23 01:38:09.035008 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.034908    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" (UID: "5f00666e-b0c6-4ba0-aaa9-9180c7e2f181"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:38:09.035124 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.035060    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr" (OuterVolumeSpecName: "kube-api-access-db5xr") pod "5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" (UID: "5f00666e-b0c6-4ba0-aaa9-9180c7e2f181"). InnerVolumeSpecName "kube-api-access-db5xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:38:09.133552 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.133522    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-webhook-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:38:09.133552 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.133548    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db5xr\" (UniqueName: \"kubernetes.io/projected/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181-kube-api-access-db5xr\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:38:09.276288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.276214    2572 generic.go:356] "Generic (PLEG): container finished" podID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" containerID="8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18" exitCode=0
Jul 23 01:38:09.276288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.276258    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-684bd45b87-kf6jc"
Jul 23 01:38:09.276288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.276267    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684bd45b87-kf6jc" event={"ID":"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181","Type":"ContainerDied","Data":"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"}
Jul 23 01:38:09.276770 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.276307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-684bd45b87-kf6jc" event={"ID":"5f00666e-b0c6-4ba0-aaa9-9180c7e2f181","Type":"ContainerDied","Data":"d4221d6967883e3b71149fce932dabaaa75c6b117f7080c4d6f0147474adda63"}
Jul 23 01:38:09.276770 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.276328    2572 scope.go:117] "RemoveContainer" containerID="8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"
Jul 23 01:38:09.284983 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.284967    2572 scope.go:117] "RemoveContainer" containerID="8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"
Jul 23 01:38:09.285222 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:38:09.285203    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18\": container with ID starting with 8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18 not found: ID does not exist" containerID="8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"
Jul 23 01:38:09.285301 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.285230    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18"} err="failed to get container status \"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18\": rpc error: code = NotFound desc = could not find container \"8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18\": container with ID starting with 8c01b2d08eb620547f072e669d13a5869736d34cc7f1f7d5e502208d55f5ef18 not found: ID does not exist"
Jul 23 01:38:09.296091 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.296069    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:38:09.299298 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:09.299278    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-684bd45b87-kf6jc"]
Jul 23 01:38:10.748837 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:10.748805    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" path="/var/lib/kubelet/pods/5f00666e-b0c6-4ba0-aaa9-9180c7e2f181/volumes"
Jul 23 01:38:28.849851 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:28.849800    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:29.573289 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.573256    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"]
Jul 23 01:38:29.573638 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.573625    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" containerName="manager"
Jul 23 01:38:29.573690 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.573640    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" containerName="manager"
Jul 23 01:38:29.573725 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.573713    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f00666e-b0c6-4ba0-aaa9-9180c7e2f181" containerName="manager"
Jul 23 01:38:29.577112 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.577090    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.579244 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.579224    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 01:38:29.579348 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.579313    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rzlfw\""
Jul 23 01:38:29.579348 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.579324    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 01:38:29.579348 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.579313    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 01:38:29.584019 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.584001    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"]
Jul 23 01:38:29.678902 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.678875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.679067 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.678913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a94593a-0d2b-4962-ac53-099ae95df2da-openshift-service-ca\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.679067 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.678948    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x2sm\" (UniqueName: \"kubernetes.io/projected/3a94593a-0d2b-4962-ac53-099ae95df2da-kube-api-access-8x2sm\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.780224 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.780192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.780224 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.780225    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a94593a-0d2b-4962-ac53-099ae95df2da-openshift-service-ca\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.780509 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.780251    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x2sm\" (UniqueName: \"kubernetes.io/projected/3a94593a-0d2b-4962-ac53-099ae95df2da-kube-api-access-8x2sm\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.780509 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:38:29.780361    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 23 01:38:29.780509 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:38:29.780462    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls podName:3a94593a-0d2b-4962-ac53-099ae95df2da nodeName:}" failed. No retries permitted until 2026-07-23 01:38:30.280414454 +0000 UTC m=+622.029474104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls") pod "maas-api-6b7b9f6f57-8ww4w" (UID: "3a94593a-0d2b-4962-ac53-099ae95df2da") : secret "maas-api-serving-cert" not found
Jul 23 01:38:29.780939 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.780917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a94593a-0d2b-4962-ac53-099ae95df2da-openshift-service-ca\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:29.788197 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:29.788175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x2sm\" (UniqueName: \"kubernetes.io/projected/3a94593a-0d2b-4962-ac53-099ae95df2da-kube-api-access-8x2sm\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:30.203961 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.203928    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"]
Jul 23 01:38:30.207689 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.207671    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.210069 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.210037    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 01:38:30.210069 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.210067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-42wv9\""
Jul 23 01:38:30.217852 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.217819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"]
Jul 23 01:38:30.265288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.265261    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:30.289191 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.289156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b2b9b0-9b7f-4d76-a279-86fcec044868-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.289350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.289217    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:30.289350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.289245    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhgwd\" (UniqueName: \"kubernetes.io/projected/f2b2b9b0-9b7f-4d76-a279-86fcec044868-kube-api-access-xhgwd\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.291842 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.291816    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a94593a-0d2b-4962-ac53-099ae95df2da-maas-api-tls\") pod \"maas-api-6b7b9f6f57-8ww4w\" (UID: \"3a94593a-0d2b-4962-ac53-099ae95df2da\") " pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:30.390362 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.390328    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b2b9b0-9b7f-4d76-a279-86fcec044868-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.390546 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.390375    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhgwd\" (UniqueName: \"kubernetes.io/projected/f2b2b9b0-9b7f-4d76-a279-86fcec044868-kube-api-access-xhgwd\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.390996 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.390975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f2b2b9b0-9b7f-4d76-a279-86fcec044868-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.398754 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.398727    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhgwd\" (UniqueName: \"kubernetes.io/projected/f2b2b9b0-9b7f-4d76-a279-86fcec044868-kube-api-access-xhgwd\") pod \"payload-pre-processing-7677b774bb-l5gmb\" (UID: \"f2b2b9b0-9b7f-4d76-a279-86fcec044868\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.488991 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.488924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:30.519905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.519878    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:30.635606 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.635575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"]
Jul 23 01:38:30.640250 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:38:30.640208    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a94593a_0d2b_4962_ac53_099ae95df2da.slice/crio-fa2c90f96559542c0997e01744c1dd942683019b7a6e59ee108b20a311527cbe WatchSource:0}: Error finding container fa2c90f96559542c0997e01744c1dd942683019b7a6e59ee108b20a311527cbe: Status 404 returned error can't find the container with id fa2c90f96559542c0997e01744c1dd942683019b7a6e59ee108b20a311527cbe
Jul 23 01:38:30.660609 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:30.660582    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"]
Jul 23 01:38:30.663657 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:38:30.663629    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2b2b9b0_9b7f_4d76_a279_86fcec044868.slice/crio-73c8aca0d361e58e4909fdb8374d8e8748a0b1636f6e51d78c528e9554e37d09 WatchSource:0}: Error finding container 73c8aca0d361e58e4909fdb8374d8e8748a0b1636f6e51d78c528e9554e37d09: Status 404 returned error can't find the container with id 73c8aca0d361e58e4909fdb8374d8e8748a0b1636f6e51d78c528e9554e37d09
Jul 23 01:38:31.399302 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:31.398218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w" event={"ID":"3a94593a-0d2b-4962-ac53-099ae95df2da","Type":"ContainerStarted","Data":"fa2c90f96559542c0997e01744c1dd942683019b7a6e59ee108b20a311527cbe"}
Jul 23 01:38:31.401610 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:31.401577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb" event={"ID":"f2b2b9b0-9b7f-4d76-a279-86fcec044868","Type":"ContainerStarted","Data":"73c8aca0d361e58e4909fdb8374d8e8748a0b1636f6e51d78c528e9554e37d09"}
Jul 23 01:38:34.417813 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.417778    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w" event={"ID":"3a94593a-0d2b-4962-ac53-099ae95df2da","Type":"ContainerStarted","Data":"774482a996f2ae70fcbc9e13931ea1555a565059920c71d956ecd07730e25daa"}
Jul 23 01:38:34.418272 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.417933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:34.419329 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.419305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb" event={"ID":"f2b2b9b0-9b7f-4d76-a279-86fcec044868","Type":"ContainerStarted","Data":"32a81047d640c3d17e7bd853575da46b4e3ddf2d633c5ef0b932370f1df891c7"}
Jul 23 01:38:34.419451 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.419350    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:34.433415 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.433371    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w" podStartSLOduration=2.229755584 podStartE2EDuration="5.433356608s" totalImagesPullingTime="3.203601024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:38:34.432382326 +0000 UTC m=+626.181442008" watchObservedRunningTime="2026-07-23 01:38:34.433356608 +0000 UTC m=+626.182416279"
Jul 23 01:38:34.447195 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:34.447151    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb" podStartSLOduration=1.198824209 podStartE2EDuration="4.447137065s" totalImagesPullingTime="3.248312856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:38:34.446415836 +0000 UTC m=+626.195475507" watchObservedRunningTime="2026-07-23 01:38:34.447137065 +0000 UTC m=+626.196196737"
Jul 23 01:38:38.438927 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.438894    2572 generic.go:356] "Generic (PLEG): container finished" podID="2d53130c-ace9-4fdc-9c66-7e5d060670e5" containerID="75680a12ac5d834ac43c840f7e65da1b4248dad710f7bffd96ddd1e1ea78fd6c" exitCode=0
Jul 23 01:38:38.439327 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.438935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" event={"ID":"2d53130c-ace9-4fdc-9c66-7e5d060670e5","Type":"ContainerDied","Data":"75680a12ac5d834ac43c840f7e65da1b4248dad710f7bffd96ddd1e1ea78fd6c"}
Jul 23 01:38:38.439327 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.439272    2572 scope.go:117] "RemoveContainer" containerID="75680a12ac5d834ac43c840f7e65da1b4248dad710f7bffd96ddd1e1ea78fd6c"
Jul 23 01:38:38.440216 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.440188    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:38:38.440290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.440272    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:38:38.440359 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:38.440344    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:38:39.445740 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:39.445709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" event={"ID":"2d53130c-ace9-4fdc-9c66-7e5d060670e5","Type":"ContainerStarted","Data":"469082c95e13a7d5928ba361aae58221d410e8b121960f8c76ecf439dfbb96e2"}
Jul 23 01:38:39.722116 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:39.722033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:38:39.722285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:39.722198    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rwx9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 23 01:38:39.722285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:39.722246    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" podUID="2d53130c-ace9-4fdc-9c66-7e5d060670e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 23 01:38:40.429455 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:40.429416    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b7b9f6f57-8ww4w"
Jul 23 01:38:40.722505 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:40.722399    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rwx9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 23 01:38:40.722505 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:40.722485    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" podUID="2d53130c-ace9-4fdc-9c66-7e5d060670e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 23 01:38:41.398219 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:41.398179    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:41.493996 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:41.493953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:41.722955 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:41.722911    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rwx9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 23 01:38:41.723429 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:41.722984    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" podUID="2d53130c-ace9-4fdc-9c66-7e5d060670e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 23 01:38:42.722412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:42.722376    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-rwx9n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body=
Jul 23 01:38:42.722619 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:42.722466    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n" podUID="2d53130c-ace9-4fdc-9c66-7e5d060670e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused"
Jul 23 01:38:43.725772 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:43.725739    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:38:43.726197 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:43.725994    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:38:43.726781 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:43.726763    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-rwx9n"
Jul 23 01:38:45.426599 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:45.426571    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-l5gmb"
Jul 23 01:38:48.993298 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:48.993244    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:38:53.508798 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:38:53.508754    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:00.619274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:00.619238    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:09.879039 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:09.879003    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:09.927893 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:09.927860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:20.881961 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.881922    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"]
Jul 23 01:39:20.886698 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.886675    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.890203 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.890180    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 01:39:20.890349 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.890228    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 01:39:20.890349 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.890255    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 01:39:20.890349 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.890185    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ktgld\""
Jul 23 01:39:20.893693 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.893672    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"]
Jul 23 01:39:20.911376 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.911350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:20.924382 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924359    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.924494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924388    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.924494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924425    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.924494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcfcn\" (UniqueName: \"kubernetes.io/projected/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-kube-api-access-rcfcn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.924612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:20.924612 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:20.924532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025738 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025704    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025899 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025743    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025899 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025785    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025899 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcfcn\" (UniqueName: \"kubernetes.io/projected/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-kube-api-access-rcfcn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025899 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.025899 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.025875    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.026173 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.026152    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.026223 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.026181    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.026260 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.026238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.028073 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.028045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.028244 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.028228    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.033301 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.033281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcfcn\" (UniqueName: \"kubernetes.io/projected/29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191-kube-api-access-rcfcn\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sk4pm\" (UID: \"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.199712 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.199682    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:21.327959 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.327844    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"]
Jul 23 01:39:21.330148 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:39:21.330125    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29c4dbac_c01e_4b83_8ba3_cf6fa0ac9191.slice/crio-44f68fcbeb0db420f90a7df8a1cf518710d59944936a07c091d82671a599ff6a WatchSource:0}: Error finding container 44f68fcbeb0db420f90a7df8a1cf518710d59944936a07c091d82671a599ff6a: Status 404 returned error can't find the container with id 44f68fcbeb0db420f90a7df8a1cf518710d59944936a07c091d82671a599ff6a
Jul 23 01:39:21.331409 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.331392    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 01:39:21.634962 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:21.634859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm" event={"ID":"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191","Type":"ContainerStarted","Data":"44f68fcbeb0db420f90a7df8a1cf518710d59944936a07c091d82671a599ff6a"}
Jul 23 01:39:22.641916 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:22.641841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm" event={"ID":"29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191","Type":"ContainerStarted","Data":"213d808b838bc6f9ad20f6effdc54473cf70b960a7af24769296400fa44642e7"}
Jul 23 01:39:22.658403 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:22.658351    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm" podStartSLOduration=1.640614289 podStartE2EDuration="2.658334531s" totalImagesPullingTime="1.017720242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:39:22.656934514 +0000 UTC m=+674.405994186" watchObservedRunningTime="2026-07-23 01:39:22.658334531 +0000 UTC m=+674.407394202"
Jul 23 01:39:31.200455 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:31.200400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:31.200900 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:31.200722    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:31.212992 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:31.212970    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:31.699086 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:31.695584    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sk4pm"
Jul 23 01:39:34.391606 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.391569    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"]
Jul 23 01:39:34.394818 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.394802    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.397012 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.396991    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 23 01:39:34.402381 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.402360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"]
Jul 23 01:39:34.436339 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c2165-962f-4acf-b528-28a96d01b191-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.436501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.436501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436423    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.436501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436482    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.436651 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.436651 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.436535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwkfr\" (UniqueName: \"kubernetes.io/projected/d14c2165-962f-4acf-b528-28a96d01b191-kube-api-access-dwkfr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.483541 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.483511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:34.537739 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537710    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.537739 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537740    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.537944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537759    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.537944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537780    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwkfr\" (UniqueName: \"kubernetes.io/projected/d14c2165-962f-4acf-b528-28a96d01b191-kube-api-access-dwkfr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.537944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537839    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c2165-962f-4acf-b528-28a96d01b191-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.537944 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.537861    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.538194 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.538169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.538256 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.538197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.538303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.538286    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.540088 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.540059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d14c2165-962f-4acf-b528-28a96d01b191-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.540311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.540292    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d14c2165-962f-4acf-b528-28a96d01b191-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.545386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.545362    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwkfr\" (UniqueName: \"kubernetes.io/projected/d14c2165-962f-4acf-b528-28a96d01b191-kube-api-access-dwkfr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl\" (UID: \"d14c2165-962f-4acf-b528-28a96d01b191\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.705710 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.705685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:34.837715 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:34.837689    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"]
Jul 23 01:39:34.839342 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:39:34.839309    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14c2165_962f_4acf_b528_28a96d01b191.slice/crio-35d7f0ffd7e0da367b1f4c2a3abf79e0d41a5d70cca1221ea082a678c95e1128 WatchSource:0}: Error finding container 35d7f0ffd7e0da367b1f4c2a3abf79e0d41a5d70cca1221ea082a678c95e1128: Status 404 returned error can't find the container with id 35d7f0ffd7e0da367b1f4c2a3abf79e0d41a5d70cca1221ea082a678c95e1128
Jul 23 01:39:35.704855 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:35.704823    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl" event={"ID":"d14c2165-962f-4acf-b528-28a96d01b191","Type":"ContainerStarted","Data":"cbd4d9192f1ef538a57ced6b3dfd0fc1de53a3cb5eb740d8732e4e1b26c48b70"}
Jul 23 01:39:35.705282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:35.704883    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl" event={"ID":"d14c2165-962f-4acf-b528-28a96d01b191","Type":"ContainerStarted","Data":"35d7f0ffd7e0da367b1f4c2a3abf79e0d41a5d70cca1221ea082a678c95e1128"}
Jul 23 01:39:35.723953 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:35.723909    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl" podStartSLOduration=1.540071518 podStartE2EDuration="1.723896858s" totalImagesPullingTime="183.82534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:39:35.721547094 +0000 UTC m=+687.470606766" watchObservedRunningTime="2026-07-23 01:39:35.723896858 +0000 UTC m=+687.472956530"
Jul 23 01:39:44.706132 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:44.706104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:44.706601 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:44.706190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:44.718593 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:44.718574    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:44.758888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:44.758867    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl"
Jul 23 01:39:45.009566 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:45.009490    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:39:52.601475 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:39:52.601422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:03.719149 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.719110    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cf8cf7d96-t9x7t"]
Jul 23 01:41:03.722531 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.722512    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.730490 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.730469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cf8cf7d96-t9x7t"]
Jul 23 01:41:03.834910 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.834884    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4de5b36c-029b-4ed8-9572-e84a9582e39d-tls-cert\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.835051 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.834952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t8gb\" (UniqueName: \"kubernetes.io/projected/4de5b36c-029b-4ed8-9572-e84a9582e39d-kube-api-access-8t8gb\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.935747 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.935723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4de5b36c-029b-4ed8-9572-e84a9582e39d-tls-cert\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.935877 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.935768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t8gb\" (UniqueName: \"kubernetes.io/projected/4de5b36c-029b-4ed8-9572-e84a9582e39d-kube-api-access-8t8gb\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.938060 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.938036    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4de5b36c-029b-4ed8-9572-e84a9582e39d-tls-cert\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:03.942941 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:03.942919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t8gb\" (UniqueName: \"kubernetes.io/projected/4de5b36c-029b-4ed8-9572-e84a9582e39d-kube-api-access-8t8gb\") pod \"authorino-7cf8cf7d96-t9x7t\" (UID: \"4de5b36c-029b-4ed8-9572-e84a9582e39d\") " pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:04.032621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:04.032565    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t"
Jul 23 01:41:04.126956 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:04.126909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:04.162387 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:04.162360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cf8cf7d96-t9x7t"]
Jul 23 01:41:04.164736 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:41:04.164710    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4de5b36c_029b_4ed8_9572_e84a9582e39d.slice/crio-49ca2cd06eeaa1cc8ba9ae27cc4107d1a9bf96e43d8edd7e37d119fa9befd8f4 WatchSource:0}: Error finding container 49ca2cd06eeaa1cc8ba9ae27cc4107d1a9bf96e43d8edd7e37d119fa9befd8f4: Status 404 returned error can't find the container with id 49ca2cd06eeaa1cc8ba9ae27cc4107d1a9bf96e43d8edd7e37d119fa9befd8f4
Jul 23 01:41:04.227136 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:04.227105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:05.106385 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.106342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t" event={"ID":"4de5b36c-029b-4ed8-9572-e84a9582e39d","Type":"ContainerStarted","Data":"4db3ae2ab2ebb57170e951cdaa9234a143d2328c7cf4ce7491e291e58094d533"}
Jul 23 01:41:05.106385 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.106389    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t" event={"ID":"4de5b36c-029b-4ed8-9572-e84a9582e39d","Type":"ContainerStarted","Data":"49ca2cd06eeaa1cc8ba9ae27cc4107d1a9bf96e43d8edd7e37d119fa9befd8f4"}
Jul 23 01:41:05.132065 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.132006    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cf8cf7d96-t9x7t" podStartSLOduration=1.70753278 podStartE2EDuration="2.13198377s" totalImagesPullingTime="424.45099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:41:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:41:05.130000126 +0000 UTC m=+776.879059799" watchObservedRunningTime="2026-07-23 01:41:05.13198377 +0000 UTC m=+776.881043444"
Jul 23 01:41:05.158870 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.158833    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:41:05.159319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.159286    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-68d6474745-9gwxw" podUID="a3670490-7fc7-40be-83c6-cd6923a9d498" containerName="authorino" containerID="cri-o://79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17" gracePeriod=30
Jul 23 01:41:05.261056 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.261002    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:05.363832 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.363707    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:05.437365 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.437338    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:41:05.551386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.551349    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert\") pod \"a3670490-7fc7-40be-83c6-cd6923a9d498\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") "
Jul 23 01:41:05.551595 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.551410    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69gdt\" (UniqueName: \"kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt\") pod \"a3670490-7fc7-40be-83c6-cd6923a9d498\" (UID: \"a3670490-7fc7-40be-83c6-cd6923a9d498\") "
Jul 23 01:41:05.553570 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.553530    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt" (OuterVolumeSpecName: "kube-api-access-69gdt") pod "a3670490-7fc7-40be-83c6-cd6923a9d498" (UID: "a3670490-7fc7-40be-83c6-cd6923a9d498"). InnerVolumeSpecName "kube-api-access-69gdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:41:05.561735 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.561706    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a3670490-7fc7-40be-83c6-cd6923a9d498" (UID: "a3670490-7fc7-40be-83c6-cd6923a9d498"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:41:05.652311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.652220    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a3670490-7fc7-40be-83c6-cd6923a9d498-tls-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:41:05.652311 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:05.652271    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69gdt\" (UniqueName: \"kubernetes.io/projected/a3670490-7fc7-40be-83c6-cd6923a9d498-kube-api-access-69gdt\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:41:06.114760 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.114713    2572 generic.go:356] "Generic (PLEG): container finished" podID="a3670490-7fc7-40be-83c6-cd6923a9d498" containerID="79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17" exitCode=0
Jul 23 01:41:06.115516 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.115494    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d6474745-9gwxw"
Jul 23 01:41:06.128465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.128380    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d6474745-9gwxw" event={"ID":"a3670490-7fc7-40be-83c6-cd6923a9d498","Type":"ContainerDied","Data":"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"}
Jul 23 01:41:06.128465 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.128464    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68d6474745-9gwxw" event={"ID":"a3670490-7fc7-40be-83c6-cd6923a9d498","Type":"ContainerDied","Data":"9b60fd1ab137b014995538cf803bb72b4ee43e1470d93aab0618559c8ef9b59a"}
Jul 23 01:41:06.128663 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.128492    2572 scope.go:117] "RemoveContainer" containerID="79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"
Jul 23 01:41:06.139539 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.139519    2572 scope.go:117] "RemoveContainer" containerID="79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"
Jul 23 01:41:06.139833 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:41:06.139814    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17\": container with ID starting with 79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17 not found: ID does not exist" containerID="79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"
Jul 23 01:41:06.139892 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.139843    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17"} err="failed to get container status \"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17\": rpc error: code = NotFound desc = could not find container \"79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17\": container with ID starting with 79c47a1ba47959aa3c387369a3e2cf5a0e0ec133f325e90d093360cd68646e17 not found: ID does not exist"
Jul 23 01:41:06.150103 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.150050    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:41:06.152517 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.152494    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68d6474745-9gwxw"]
Jul 23 01:41:06.748246 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:06.748210    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3670490-7fc7-40be-83c6-cd6923a9d498" path="/var/lib/kubelet/pods/a3670490-7fc7-40be-83c6-cd6923a9d498/volumes"
Jul 23 01:41:50.859936 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:50.859898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:41:53.816602 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:41:53.816562    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:08.745334 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:08.745241    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:43:08.748939 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:08.748914    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:43:09.743634 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:09.743593    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:10.981049 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:10.981015    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:46.330094 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:46.330055    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:47.631097 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:47.631056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:52.150416 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:52.150374    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:52.251708 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:52.251650    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:52.348601 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:52.348572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:52.496114 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:52.496082    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:58.076354 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:58.076319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:43:58.130759 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:43:58.130731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:45:28.084985 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:45:28.084939    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:45:53.834416 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:45:53.834380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:46:56.126055 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:46:56.126014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:48:08.774261 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:48:08.774233    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:48:08.775298 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:48:08.775280    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:49:54.280332 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:49:54.280301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:51:26.299490 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.299452    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:51:26.299976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.299813    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3670490-7fc7-40be-83c6-cd6923a9d498" containerName="authorino"
Jul 23 01:51:26.299976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.299824    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3670490-7fc7-40be-83c6-cd6923a9d498" containerName="authorino"
Jul 23 01:51:26.299976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.299906    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3670490-7fc7-40be-83c6-cd6923a9d498" containerName="authorino"
Jul 23 01:51:26.302862 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.302845    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.305139 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.305117    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-98bdf318-kserve-self-signed-certs\""
Jul 23 01:51:26.319545 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.319524    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:51:26.334375 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334351    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.334522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.334522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334411    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hswfj\" (UniqueName: \"kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.334522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334493    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.334522 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334519    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.334857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.334540    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.401653 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.401631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:51:26.435639 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435613    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.435723 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435664    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.435723 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.435806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435733    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hswfj\" (UniqueName: \"kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.435806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435763    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.435806 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.435800    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.436020 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.436000    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.436137 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.436110    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.436237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.436148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.437998 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.437977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.438196 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.438176    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.444183 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.444161    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hswfj\" (UniqueName: \"kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj\") pod \"e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") " pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.611886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.611778    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:26.742511 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.742487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:51:26.745544 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:51:26.745509    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b4b9048_3bd7_455b_91e5_a8008c4e0980.slice/crio-b3f9ad87043e82a7bfbfe2e6ca746237775e02dc6aca137e08748120c55db9c6 WatchSource:0}: Error finding container b3f9ad87043e82a7bfbfe2e6ca746237775e02dc6aca137e08748120c55db9c6: Status 404 returned error can't find the container with id b3f9ad87043e82a7bfbfe2e6ca746237775e02dc6aca137e08748120c55db9c6
Jul 23 01:51:26.936665 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.936638    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" event={"ID":"4b4b9048-3bd7-455b-91e5-a8008c4e0980","Type":"ContainerStarted","Data":"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"}
Jul 23 01:51:26.936817 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.936677    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" event={"ID":"4b4b9048-3bd7-455b-91e5-a8008c4e0980","Type":"ContainerStarted","Data":"b3f9ad87043e82a7bfbfe2e6ca746237775e02dc6aca137e08748120c55db9c6"}
Jul 23 01:51:26.952947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:26.952906    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" podStartSLOduration=0.952890144 podStartE2EDuration="952.890144ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:51:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:51:26.952124894 +0000 UTC m=+1398.701184566" watchObservedRunningTime="2026-07-23 01:51:26.952890144 +0000 UTC m=+1398.701949816"
Jul 23 01:51:31.913206 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:31.913174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:51:36.612670 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:36.612581    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:36.613496 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:36.613469    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:36.636216 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:36.636190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:36.993213 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:36.993163    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:51:57.166274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:57.166239    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:51:57.188189 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:57.188164    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:51:58.613957 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:51:58.613924    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:52:12.187285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.187197    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" podUID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" containerName="main" containerID="cri-o://f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc" gracePeriod=45
Jul 23 01:52:12.433020 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.432997    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:52:12.626055 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.625977    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626055 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626050    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626100    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626155    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hswfj\" (UniqueName: \"kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626179    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626282 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626208    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm\") pod \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\" (UID: \"4b4b9048-3bd7-455b-91e5-a8008c4e0980\") "
Jul 23 01:52:12.626539 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home" (OuterVolumeSpecName: "home") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:52:12.626657 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626562    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:52:12.626657 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626617    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-home\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:12.626657 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.626621    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:52:12.628645 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.628611    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm" (OuterVolumeSpecName: "dshm") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:52:12.628748 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.628665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj" (OuterVolumeSpecName: "kube-api-access-hswfj") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "kube-api-access-hswfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:52:12.628748 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.628690    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b4b9048-3bd7-455b-91e5-a8008c4e0980" (UID: "4b4b9048-3bd7-455b-91e5-a8008c4e0980"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:52:12.727088 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.727057    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tmp-dir\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:12.727088 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.727081    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b4b9048-3bd7-455b-91e5-a8008c4e0980-tls-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:12.727088 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.727092    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hswfj\" (UniqueName: \"kubernetes.io/projected/4b4b9048-3bd7-455b-91e5-a8008c4e0980-kube-api-access-hswfj\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:12.727305 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.727100    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-model-cache\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:12.727305 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:12.727108    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b4b9048-3bd7-455b-91e5-a8008c4e0980-dshm\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:52:13.147827 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.147795    2572 generic.go:356] "Generic (PLEG): container finished" podID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" containerID="f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc" exitCode=0
Jul 23 01:52:13.148010 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.147840    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"
Jul 23 01:52:13.148010 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.147859    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" event={"ID":"4b4b9048-3bd7-455b-91e5-a8008c4e0980","Type":"ContainerDied","Data":"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"}
Jul 23 01:52:13.148010 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.147889    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8" event={"ID":"4b4b9048-3bd7-455b-91e5-a8008c4e0980","Type":"ContainerDied","Data":"b3f9ad87043e82a7bfbfe2e6ca746237775e02dc6aca137e08748120c55db9c6"}
Jul 23 01:52:13.148010 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.147906    2572 scope.go:117] "RemoveContainer" containerID="f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"
Jul 23 01:52:13.156024 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.156006    2572 scope.go:117] "RemoveContainer" containerID="f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"
Jul 23 01:52:13.156257 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:52:13.156238    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc\": container with ID starting with f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc not found: ID does not exist" containerID="f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"
Jul 23 01:52:13.156307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.156266    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc"} err="failed to get container status \"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc\": rpc error: code = NotFound desc = could not find container \"f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc\": container with ID starting with f12b3bec095e15979687f73bbed78913593b22173c0f350ce2c1ce57215f23fc not found: ID does not exist"
Jul 23 01:52:13.163693 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.163672    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:52:13.168362 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:13.168332    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-98bdf318-kserve-674db59d99-72gf8"]
Jul 23 01:52:14.750413 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:52:14.750370    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" path="/var/lib/kubelet/pods/4b4b9048-3bd7-455b-91e5-a8008c4e0980/volumes"
Jul 23 01:53:08.801081 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:53:08.801056    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:53:08.801642 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:53:08.801098    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:53:59.743464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:53:59.743421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:54:34.808086 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:54:34.808035    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:02.468754 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:02.468672    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:09.433230 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:09.433197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:26.252210 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:26.252178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:28.219487 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:28.219457    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:31.274326 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:31.274292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:31.366946 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:31.366914    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:31.686194 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:31.686166    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:38.248577 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.248541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:38.360507 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.360476    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:38.492119 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.492088    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:38.806653 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.806623    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:55:38.806958 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.806946    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" containerName="main"
Jul 23 01:55:38.807012 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.806959    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" containerName="main"
Jul 23 01:55:38.807049 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.807043    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b4b9048-3bd7-455b-91e5-a8008c4e0980" containerName="main"
Jul 23 01:55:38.809938 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.809922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.812862 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.812847    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-338263ab-openshift-default-dockercfg-9zx72\""
Jul 23 01:55:38.837817 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.837798    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:55:38.843402 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.843383    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:38.948270 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948238    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948308    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948404    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pffnd\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948532    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:38.948683 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:38.948566    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.049767 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.049739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.049894 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.049771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.049894 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.049790    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.049894 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.049810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050061 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.049954    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050117 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050051    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pffnd\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050117 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050102    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050130    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050120    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050455 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050315    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050455 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050428    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.050836 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.050815    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.052261 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.052234    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.052350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.052267    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.059605 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.059549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.059706 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.059661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pffnd\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd\") pod \"e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") " pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.120188 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.120170    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:39.225888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.225857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:39.259096 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.259071    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:55:39.262323 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:55:39.262297    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2ebec1c_9e61_4749_beca_d47147796fbd.slice/crio-24cc040ddca28e772e8ba0c4880bf599f07ccb58b222d8bd011a5ef8806dc24a WatchSource:0}: Error finding container 24cc040ddca28e772e8ba0c4880bf599f07ccb58b222d8bd011a5ef8806dc24a: Status 404 returned error can't find the container with id 24cc040ddca28e772e8ba0c4880bf599f07ccb58b222d8bd011a5ef8806dc24a
Jul 23 01:55:39.264383 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.264356    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:39.264468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.264414    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:39.264468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:39.264464    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:40.100018 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:40.099981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerStarted","Data":"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"}
Jul 23 01:55:40.100288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:40.100042    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerStarted","Data":"24cc040ddca28e772e8ba0c4880bf599f07ccb58b222d8bd011a5ef8806dc24a"}
Jul 23 01:55:40.120706 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:40.120679    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:40.125325 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:40.125306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:40.135124 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:40.135084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" podStartSLOduration=2.135071694 podStartE2EDuration="2.135071694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:55:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:55:40.132620485 +0000 UTC m=+1651.881680157" watchObservedRunningTime="2026-07-23 01:55:40.135071694 +0000 UTC m=+1651.884131365"
Jul 23 01:55:41.105155 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.105128    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:41.106059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.106039    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:41.491337 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.491307    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:41.587223 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.587193    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:41.588254 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.588233    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:55:41.591680 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.591660    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.594459 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.594414    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-338263ab-serving-cert\""
Jul 23 01:55:41.601592 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.601517    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:55:41.665045 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.665014    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:41.774665 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.774586    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.774665 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.774650    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzvqj\" (UniqueName: \"kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.774857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.774706    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.795338 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.795314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:41.875535 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.875491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.875677 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.875637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.875755 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.875736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzvqj\" (UniqueName: \"kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.876196 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.876173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.878033 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.878014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.884124 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.884101    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzvqj\" (UniqueName: \"kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj\") pod \"maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:41.905036 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:41.905015    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:42.034878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:42.034844    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:55:42.037143 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:55:42.037119    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda984eeda_adc9_476d_ae6d_a6e4aa63eca5.slice/crio-04f59d8953f96259dc348d03b5bad44316b2f98c63c3e2855cc42cfe8c13aaf5 WatchSource:0}: Error finding container 04f59d8953f96259dc348d03b5bad44316b2f98c63c3e2855cc42cfe8c13aaf5: Status 404 returned error can't find the container with id 04f59d8953f96259dc348d03b5bad44316b2f98c63c3e2855cc42cfe8c13aaf5
Jul 23 01:55:42.038972 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:42.038951    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 01:55:42.109886 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:42.109854    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" event={"ID":"a984eeda-adc9-476d-ae6d-a6e4aa63eca5","Type":"ContainerStarted","Data":"04f59d8953f96259dc348d03b5bad44316b2f98c63c3e2855cc42cfe8c13aaf5"}
Jul 23 01:55:42.193579 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:42.193548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:42.291906 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:42.291842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:55:43.116336 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:43.116295    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" event={"ID":"a984eeda-adc9-476d-ae6d-a6e4aa63eca5","Type":"ContainerStarted","Data":"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"}
Jul 23 01:55:43.116738 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:43.116564    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:43.132965 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:43.132920    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" podStartSLOduration=1.697493985 podStartE2EDuration="2.132907665s" totalImagesPullingTime="435.41368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:55:43.132123348 +0000 UTC m=+1654.881183024" watchObservedRunningTime="2026-07-23 01:55:43.132907665 +0000 UTC m=+1654.881967337"
Jul 23 01:55:49.126450 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:49.126352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:55:55.175970 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.175938    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerID="420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2" exitCode=0
Jul 23 01:55:55.176389 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.176008    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerDied","Data":"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"}
Jul 23 01:55:55.176452 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.176387    2572 scope.go:117] "RemoveContainer" containerID="420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"
Jul 23 01:55:55.177397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.177366    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:55.177492 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.177473    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:55.177533 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:55.177525    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:55:56.105799 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:56.105758    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:56.194144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:56.194099    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerStarted","Data":"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"}
Jul 23 01:55:57.120922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:57.120891    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:55:57.121947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:57.121919    2572 patch_prober.go:28] interesting pod/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 01:55:57.122094 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:57.121975    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 01:55:58.121276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:58.121241    2572 patch_prober.go:28] interesting pod/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 01:55:58.121777 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:58.121315    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 01:55:59.121080 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:59.121042    2572 patch_prober.go:28] interesting pod/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Jul 23 01:55:59.121269 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:55:59.121098    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Jul 23 01:56:00.124642 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:00.124606    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:56:00.125031 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:00.124864    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:56:00.125501 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:00.125485    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:56:17.473164 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.473127    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:56:17.473711 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.473377    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" podUID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" containerName="maas-api" containerID="cri-o://43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d" gracePeriod=30
Jul 23 01:56:17.492170 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.492144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:17.719139 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.719115    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:56:17.772989 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.772912    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzvqj\" (UniqueName: \"kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj\") pod \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") "
Jul 23 01:56:17.772989 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.772973    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls\") pod \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") "
Jul 23 01:56:17.773182 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.773006    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca\") pod \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\" (UID: \"a984eeda-adc9-476d-ae6d-a6e4aa63eca5\") "
Jul 23 01:56:17.773395 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.773372    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a984eeda-adc9-476d-ae6d-a6e4aa63eca5" (UID: "a984eeda-adc9-476d-ae6d-a6e4aa63eca5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:56:17.775031 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.775010    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj" (OuterVolumeSpecName: "kube-api-access-hzvqj") pod "a984eeda-adc9-476d-ae6d-a6e4aa63eca5" (UID: "a984eeda-adc9-476d-ae6d-a6e4aa63eca5"). InnerVolumeSpecName "kube-api-access-hzvqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:56:17.775104 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.775037    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a984eeda-adc9-476d-ae6d-a6e4aa63eca5" (UID: "a984eeda-adc9-476d-ae6d-a6e4aa63eca5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:56:17.873743 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.873706    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:17.873743 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.873740    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzvqj\" (UniqueName: \"kubernetes.io/projected/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-kube-api-access-hzvqj\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:17.873743 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:17.873750    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a984eeda-adc9-476d-ae6d-a6e4aa63eca5-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:18.301671 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.301637    2572 generic.go:356] "Generic (PLEG): container finished" podID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" containerID="43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d" exitCode=0
Jul 23 01:56:18.301882 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.301689    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"
Jul 23 01:56:18.301882 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.301718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" event={"ID":"a984eeda-adc9-476d-ae6d-a6e4aa63eca5","Type":"ContainerDied","Data":"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"}
Jul 23 01:56:18.301882 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.301767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg" event={"ID":"a984eeda-adc9-476d-ae6d-a6e4aa63eca5","Type":"ContainerDied","Data":"04f59d8953f96259dc348d03b5bad44316b2f98c63c3e2855cc42cfe8c13aaf5"}
Jul 23 01:56:18.302871 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.301789    2572 scope.go:117] "RemoveContainer" containerID="43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"
Jul 23 01:56:18.312176 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.312161    2572 scope.go:117] "RemoveContainer" containerID="43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"
Jul 23 01:56:18.312413 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:56:18.312394    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d\": container with ID starting with 43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d not found: ID does not exist" containerID="43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"
Jul 23 01:56:18.312499 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.312421    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d"} err="failed to get container status \"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d\": rpc error: code = NotFound desc = could not find container \"43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d\": container with ID starting with 43cdc1a3f80abcf7146f480676a4658925a3adc2cbd2012252257bf2d8f1310d not found: ID does not exist"
Jul 23 01:56:18.322860 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.322839    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:56:18.326536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.326517    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-338263ab-77cdccbf8-zwvkg"]
Jul 23 01:56:18.749627 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:18.749597    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" path="/var/lib/kubelet/pods/a984eeda-adc9-476d-ae6d-a6e4aa63eca5/volumes"
Jul 23 01:56:22.140933 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.140898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:22.263188 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.263148    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:56:22.263420 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.263394    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy" containerID="cri-o://6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d" gracePeriod=30
Jul 23 01:56:22.285075 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.285044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:22.521846 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.521810    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:22.760008 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.759973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:22.864085 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.864017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:22.974216 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:22.974173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:23.245373 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.245340    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:56:23.245883 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.245867    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" containerName="maas-api"
Jul 23 01:56:23.245976 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.245886    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" containerName="maas-api"
Jul 23 01:56:23.246016 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.246000    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a984eeda-adc9-476d-ae6d-a6e4aa63eca5" containerName="maas-api"
Jul 23 01:56:23.249229 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.249209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.251650 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.251633    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-dafa5c71-gw-openshift-default-dockercfg-h5ldh\""
Jul 23 01:56:23.260164 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.260139    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:56:23.268916 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.268899    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:23.322254 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322233    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322281    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322310    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plb64\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322646 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322509    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322646 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322537    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322646 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322577    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.322772 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.322649    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423070 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423029    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423070 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423165    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423296    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423349    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423569 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plb64\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423709 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423577    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423709 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423620    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423791 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423724    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.423828 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.423805    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.424094 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.424077    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.425372 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.425353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.425801 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.425782    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.431491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.431465    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.431950 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.431930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plb64\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64\") pod \"e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") " pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.560143 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.560069    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:23.713826 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.713803    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:56:23.715460 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:56:23.715412    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b1a205f_52ad_4835_8fce_91a9ef0e68f8.slice/crio-d94c78012f8edca37c3b2a3a9dd6fda8ed0713608c70551e13218fafbbc5450e WatchSource:0}: Error finding container d94c78012f8edca37c3b2a3a9dd6fda8ed0713608c70551e13218fafbbc5450e: Status 404 returned error can't find the container with id d94c78012f8edca37c3b2a3a9dd6fda8ed0713608c70551e13218fafbbc5450e
Jul 23 01:56:23.717677 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.717649    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:23.717755 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.717707    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:23.717755 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.717735    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:23.831323 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:23.831245    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:24.331887 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:24.331848    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerStarted","Data":"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"}
Jul 23 01:56:24.332297 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:24.331905    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerStarted","Data":"d94c78012f8edca37c3b2a3a9dd6fda8ed0713608c70551e13218fafbbc5450e"}
Jul 23 01:56:24.351552 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:24.351511    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podStartSLOduration=1.351498358 podStartE2EDuration="1.351498358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:56:24.349982946 +0000 UTC m=+1696.099042622" watchObservedRunningTime="2026-07-23 01:56:24.351498358 +0000 UTC m=+1696.100558029"
Jul 23 01:56:24.561117 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:24.561087    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:24.565921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:24.565889    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:25.336447 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:25.336409    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:25.337484 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:25.337465    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:25.909025 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:25.908988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:26.193356 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.193327    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:56:26.195878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.195852    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.198146 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.198129    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dafa5c71-serving-cert\""
Jul 23 01:56:26.205610 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.205585    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:56:26.215735 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.215709    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:26.247250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.247219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.247250 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.247249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb6pg\" (UniqueName: \"kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.247428 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.247327    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.347974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.347941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.347974 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.347973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb6pg\" (UniqueName: \"kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.348488 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.348002    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.348488 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:56:26.348073    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-serving-cert: secret "maas-api-e2e-migrate-dafa5c71-serving-cert" not found
Jul 23 01:56:26.348488 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:56:26.348135    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls podName:23354527-b5b0-445c-b0d1-244e30f99967 nodeName:}" failed. No retries permitted until 2026-07-23 01:56:26.848118403 +0000 UTC m=+1698.597178054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls") pod "maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" (UID: "23354527-b5b0-445c-b0d1-244e30f99967") : secret "maas-api-e2e-migrate-dafa5c71-serving-cert" not found
Jul 23 01:56:26.348647 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.348631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.356308 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.356278    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb6pg\" (UniqueName: \"kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.593098 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.593017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:26.693993 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.693960    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:26.793611 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.793579    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:56:26.852681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.852595    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:26.855135 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:26.855118    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") pod \"maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:27.108093 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.108011    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:27.443368 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.443343    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:56:27.445809 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:56:27.445782    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23354527_b5b0_445c_b0d1_244e30f99967.slice/crio-48fc29c28d8301683b4d244c018fc1c103be71da4c7ae29cfff4b8585e39e805 WatchSource:0}: Error finding container 48fc29c28d8301683b4d244c018fc1c103be71da4c7ae29cfff4b8585e39e805: Status 404 returned error can't find the container with id 48fc29c28d8301683b4d244c018fc1c103be71da4c7ae29cfff4b8585e39e805
Jul 23 01:56:27.510798 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.510777    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:56:27.659747 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.659875 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659766    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.659875 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659799    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.659875 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659832    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.659875 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659860    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pffnd\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.660034 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659918    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.660034 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.660034 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.659996    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:56:27.660034 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660024    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.660237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660061    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy\") pod \"d2ebec1c-9e61-4749-beca-d47147796fbd\" (UID: \"d2ebec1c-9e61-4749-beca-d47147796fbd\") "
Jul 23 01:56:27.660237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660177    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:56:27.660344 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660272    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:56:27.660494 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660477    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.660561 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660495    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2ebec1c-9e61-4749-beca-d47147796fbd-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.660561 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660508    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.660862 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.660835    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:56:27.661104 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.661081    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:56:27.662295 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.662268    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 01:56:27.662396 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.662298    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd" (OuterVolumeSpecName: "kube-api-access-pffnd") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "kube-api-access-pffnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:56:27.662496 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.662414    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:56:27.662496 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.662466    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2ebec1c-9e61-4749-beca-d47147796fbd" (UID: "d2ebec1c-9e61-4749-beca-d47147796fbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:56:27.761758 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761734    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.761758 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761756    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.761897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761769    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.761897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761781    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.761897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761792    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2ebec1c-9e61-4749-beca-d47147796fbd-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:27.761897 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:27.761805    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pffnd\" (UniqueName: \"kubernetes.io/projected/d2ebec1c-9e61-4749-beca-d47147796fbd-kube-api-access-pffnd\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:56:28.351733 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.351693    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" event={"ID":"23354527-b5b0-445c-b0d1-244e30f99967","Type":"ContainerStarted","Data":"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"}
Jul 23 01:56:28.351940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.351756    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" event={"ID":"23354527-b5b0-445c-b0d1-244e30f99967","Type":"ContainerStarted","Data":"48fc29c28d8301683b4d244c018fc1c103be71da4c7ae29cfff4b8585e39e805"}
Jul 23 01:56:28.351940 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.351783    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:28.353276 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.353252    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerID="6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d" exitCode=0
Jul 23 01:56:28.353386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.353288    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"
Jul 23 01:56:28.353386 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.353348    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerDied","Data":"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"}
Jul 23 01:56:28.353491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.353386    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w" event={"ID":"d2ebec1c-9e61-4749-beca-d47147796fbd","Type":"ContainerDied","Data":"24cc040ddca28e772e8ba0c4880bf599f07ccb58b222d8bd011a5ef8806dc24a"}
Jul 23 01:56:28.353491 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.353408    2572 scope.go:117] "RemoveContainer" containerID="6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"
Jul 23 01:56:28.362035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.362018    2572 scope.go:117] "RemoveContainer" containerID="420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"
Jul 23 01:56:28.369987 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.369967    2572 scope.go:117] "RemoveContainer" containerID="6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"
Jul 23 01:56:28.370243 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:56:28.370223    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d\": container with ID starting with 6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d not found: ID does not exist" containerID="6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"
Jul 23 01:56:28.370318 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.370250    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d"} err="failed to get container status \"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d\": rpc error: code = NotFound desc = could not find container \"6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d\": container with ID starting with 6b4b2568e50eb6fde8db4fea5624a1338df2f2e3788fed7807eb0916889e272d not found: ID does not exist"
Jul 23 01:56:28.370318 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.370266    2572 scope.go:117] "RemoveContainer" containerID="420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"
Jul 23 01:56:28.370479 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.370395    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" podStartSLOduration=1.962925356 podStartE2EDuration="2.370378563s" totalImagesPullingTime="407.453207ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:56:28.368116464 +0000 UTC m=+1700.117176137" watchObservedRunningTime="2026-07-23 01:56:28.370378563 +0000 UTC m=+1700.119438236"
Jul 23 01:56:28.370553 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:56:28.370513    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2\": container with ID starting with 420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2 not found: ID does not exist" containerID="420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"
Jul 23 01:56:28.370553 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.370539    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2"} err="failed to get container status \"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2\": rpc error: code = NotFound desc = could not find container \"420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2\": container with ID starting with 420114c378980d67f6357f17761881a3faa584ab87954519daca60222a9652c2 not found: ID does not exist"
Jul 23 01:56:28.381711 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.381691    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:56:28.385147 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.385125    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-338263ab-openshift-default-85f9f4d487-pnj2w"]
Jul 23 01:56:28.748971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:28.748939    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" path="/var/lib/kubelet/pods/d2ebec1c-9e61-4749-beca-d47147796fbd/volumes"
Jul 23 01:56:34.363591 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:34.363515    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:56:39.414797 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.414765    2572 generic.go:356] "Generic (PLEG): container finished" podID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerID="ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00" exitCode=0
Jul 23 01:56:39.415248 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.414836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerDied","Data":"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"}
Jul 23 01:56:39.415248 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.415229    2572 scope.go:117] "RemoveContainer" containerID="ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"
Jul 23 01:56:39.416289 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.416263    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:39.416359 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.416335    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:39.416406 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:39.416368    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:56:40.337422 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:40.337384    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:40.421180 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:40.421145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerStarted","Data":"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"}
Jul 23 01:56:40.560659 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:40.560626    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:40.561893 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:40.561867    2572 patch_prober.go:28] interesting pod/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 01:56:40.562029 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:40.561912    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 01:56:41.561050 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:41.561016    2572 patch_prober.go:28] interesting pod/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 01:56:41.561420 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:41.561064    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 01:56:42.560896 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:42.560859    2572 patch_prober.go:28] interesting pod/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 01:56:42.561084 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:42.560913    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 01:56:43.560422 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:43.560386    2572 patch_prober.go:28] interesting pod/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Jul 23 01:56:43.560584 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:43.560459    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Jul 23 01:56:44.564926 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:44.564895    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:44.565385 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:44.565157    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:56:44.565757 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:56:44.565742    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:57:01.238238 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.238202    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:57:01.238771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.238408    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" podUID="23354527-b5b0-445c-b0d1-244e30f99967" containerName="maas-api" containerID="cri-o://c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d" gracePeriod=30
Jul 23 01:57:01.265902 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.265874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:01.491513 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.491456    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:57:01.518532 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.518498    2572 generic.go:356] "Generic (PLEG): container finished" podID="23354527-b5b0-445c-b0d1-244e30f99967" containerID="c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d" exitCode=0
Jul 23 01:57:01.518699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.518542    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"
Jul 23 01:57:01.518699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.518576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" event={"ID":"23354527-b5b0-445c-b0d1-244e30f99967","Type":"ContainerDied","Data":"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"}
Jul 23 01:57:01.518699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.518642    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm" event={"ID":"23354527-b5b0-445c-b0d1-244e30f99967","Type":"ContainerDied","Data":"48fc29c28d8301683b4d244c018fc1c103be71da4c7ae29cfff4b8585e39e805"}
Jul 23 01:57:01.518699 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.518673    2572 scope.go:117] "RemoveContainer" containerID="c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"
Jul 23 01:57:01.530040 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.530014    2572 scope.go:117] "RemoveContainer" containerID="c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"
Jul 23 01:57:01.530339 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:01.530318    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d\": container with ID starting with c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d not found: ID does not exist" containerID="c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"
Jul 23 01:57:01.530420 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.530347    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d"} err="failed to get container status \"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d\": rpc error: code = NotFound desc = could not find container \"c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d\": container with ID starting with c9963fe99d8f30f049fdc516c5124876b184786deea91859ae1a3473e3386e2d not found: ID does not exist"
Jul 23 01:57:01.551275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.551254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") pod \"23354527-b5b0-445c-b0d1-244e30f99967\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") "
Jul 23 01:57:01.551389 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.551345    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca\") pod \"23354527-b5b0-445c-b0d1-244e30f99967\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") "
Jul 23 01:57:01.551389 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.551372    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jb6pg\" (UniqueName: \"kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg\") pod \"23354527-b5b0-445c-b0d1-244e30f99967\" (UID: \"23354527-b5b0-445c-b0d1-244e30f99967\") "
Jul 23 01:57:01.551706 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.551684    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23354527-b5b0-445c-b0d1-244e30f99967" (UID: "23354527-b5b0-445c-b0d1-244e30f99967"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:57:01.553274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.553254    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23354527-b5b0-445c-b0d1-244e30f99967" (UID: "23354527-b5b0-445c-b0d1-244e30f99967"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:57:01.553351 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.553300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg" (OuterVolumeSpecName: "kube-api-access-jb6pg") pod "23354527-b5b0-445c-b0d1-244e30f99967" (UID: "23354527-b5b0-445c-b0d1-244e30f99967"). InnerVolumeSpecName "kube-api-access-jb6pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:01.652771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.652724    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23354527-b5b0-445c-b0d1-244e30f99967-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:01.652771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.652767    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23354527-b5b0-445c-b0d1-244e30f99967-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:01.652771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.652778    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jb6pg\" (UniqueName: \"kubernetes.io/projected/23354527-b5b0-445c-b0d1-244e30f99967-kube-api-access-jb6pg\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:01.839305 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.839277    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:57:01.843193 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:01.843168    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dafa5c71-5944d78b79-m64fm"]
Jul 23 01:57:02.748794 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:02.748764    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23354527-b5b0-445c-b0d1-244e30f99967" path="/var/lib/kubelet/pods/23354527-b5b0-445c-b0d1-244e30f99967/volumes"
Jul 23 01:57:05.889244 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:05.889213    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:06.022044 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.022006    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:57:06.022267 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.022243    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy" containerID="cri-o://408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb" gracePeriod=30
Jul 23 01:57:06.047934 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.047904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:06.280655 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.280625    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:06.501110 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.501077    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:06.796836 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.796807    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:06.797181 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797168    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:06.797226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797184    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:06.797226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797210    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23354527-b5b0-445c-b0d1-244e30f99967" containerName="maas-api"
Jul 23 01:57:06.797226 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797217    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="23354527-b5b0-445c-b0d1-244e30f99967" containerName="maas-api"
Jul 23 01:57:06.797319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797278    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:06.797319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.797287    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="23354527-b5b0-445c-b0d1-244e30f99967" containerName="maas-api"
Jul 23 01:57:06.801646 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.801629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.805144 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.805125    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4bc37934-openshift-default-dockercfg-79thq\""
Jul 23 01:57:06.884909 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.884877    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:06.901916 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.901883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902234    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902267    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902350 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902322    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902597 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902353    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902597 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902385    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902597 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902424    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.902597 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.902523    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28pd\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:06.903204 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:06.903177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:07.003368 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28pd\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003565 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003565 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003565 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003685 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003585    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003685 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003685 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003679    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003868 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003730    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003868 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003762    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.003868 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.003819    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.004111 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.004083    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.004179 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.004119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.004216 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.004197    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.004337 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.004319    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.005775 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.005757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.005865 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.005804    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.012455 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.012412    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.024312 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.024288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28pd\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd\") pod \"e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") " pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.112190 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.112138    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:07.124190 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.124170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:07.247541 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.247511    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:07.250464 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:57:07.250420    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a658af6_0f12_4af6_b62a_ef70ea47df5b.slice/crio-8890a8f3385f555c217fe3676261a8263d93822fc02103fbc7d303f15cb7a9da WatchSource:0}: Error finding container 8890a8f3385f555c217fe3676261a8263d93822fc02103fbc7d303f15cb7a9da: Status 404 returned error can't find the container with id 8890a8f3385f555c217fe3676261a8263d93822fc02103fbc7d303f15cb7a9da
Jul 23 01:57:07.252524 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.252497    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:07.252590 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.252562    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:07.252626 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.252591    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:07.554324 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.554287    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerStarted","Data":"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"}
Jul 23 01:57:07.554549 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.554346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerStarted","Data":"8890a8f3385f555c217fe3676261a8263d93822fc02103fbc7d303f15cb7a9da"}
Jul 23 01:57:07.576305 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:07.576259    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podStartSLOduration=1.5762453669999998 podStartE2EDuration="1.576245367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:57:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:57:07.574319482 +0000 UTC m=+1739.323379156" watchObservedRunningTime="2026-07-23 01:57:07.576245367 +0000 UTC m=+1739.325305040"
Jul 23 01:57:08.112422 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:08.112390    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:08.117098 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:08.117074    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:08.558748 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:08.558721    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:08.559560 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:08.559541    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:09.051564 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.051528    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:09.154175 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.154076    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:09.193887 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.193861    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:09.194211 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.194199    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:09.194262 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.194212    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:09.194297 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.194276    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2ebec1c-9e61-4749-beca-d47147796fbd" containerName="istio-proxy"
Jul 23 01:57:09.198694 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.198675    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.201099 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.201081    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-4bc37934-serving-cert\""
Jul 23 01:57:09.207178 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.207154    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:09.251623 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.251563    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:09.324659 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.324633    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.324808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.324682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7q2w\" (UniqueName: \"kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.324808 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.324788    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.426128 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.426098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.426255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.426153    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7q2w\" (UniqueName: \"kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.426255 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.426226    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.426394 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:09.426377    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-serving-cert: secret "maas-api-e2e-ait-4bc37934-serving-cert" not found
Jul 23 01:57:09.426485 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:09.426476    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls podName:8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9 nodeName:}" failed. No retries permitted until 2026-07-23 01:57:09.926452058 +0000 UTC m=+1741.675511728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls") pod "maas-api-e2e-ait-4bc37934-864c798b77-grdc8" (UID: "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9") : secret "maas-api-e2e-ait-4bc37934-serving-cert" not found
Jul 23 01:57:09.426857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.426837    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.435707 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.435685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7q2w\" (UniqueName: \"kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.690954 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.690858    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:09.794132 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.794108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:09.930656 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.930623    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:09.932937 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:09.932916    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") pod \"maas-api-e2e-ait-4bc37934-864c798b77-grdc8\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:10.109716 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:10.109644    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:10.234034 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:10.234011    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:10.236861 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:57:10.236830    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb4904e_2c6d_4ffc_ad3c_dc42fb6b7af9.slice/crio-0148f9d0f0347d2d853997d153365a410934e7d567d2407ce92ba6e782cae6f8 WatchSource:0}: Error finding container 0148f9d0f0347d2d853997d153365a410934e7d567d2407ce92ba6e782cae6f8: Status 404 returned error can't find the container with id 0148f9d0f0347d2d853997d153365a410934e7d567d2407ce92ba6e782cae6f8
Jul 23 01:57:10.568565 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:10.568531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" event={"ID":"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9","Type":"ContainerStarted","Data":"0148f9d0f0347d2d853997d153365a410934e7d567d2407ce92ba6e782cae6f8"}
Jul 23 01:57:11.278470 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.278447    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:57:11.345717 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345688    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plb64\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.345858 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345737    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.345858 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345762    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.345858 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345787    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.345858 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345810    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.345858 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345848    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.346121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345922    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.346121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345950    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.346121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.345986    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:11.346121 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo\") pod \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\" (UID: \"5b1a205f-52ad-4835-8fce-91a9ef0e68f8\") "
Jul 23 01:57:11.346323 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346120    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:11.346323 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346224    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:11.346468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346355    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.346468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346375    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.346468 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346388    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.346633 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346545    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:57:11.346633 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.346595    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:11.347947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.347915    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:11.348068 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.347962    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64" (OuterVolumeSpecName: "kube-api-access-plb64") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "kube-api-access-plb64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:11.348152 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.348133    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 01:57:11.348240 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.348220    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b1a205f-52ad-4835-8fce-91a9ef0e68f8" (UID: "5b1a205f-52ad-4835-8fce-91a9ef0e68f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:11.447423 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447390    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.447423 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447422    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.447423 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447450    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.447625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447460    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plb64\" (UniqueName: \"kubernetes.io/projected/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-kube-api-access-plb64\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.447625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447470    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.447625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.447479    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b1a205f-52ad-4835-8fce-91a9ef0e68f8-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:11.574510 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.574484    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" event={"ID":"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9","Type":"ContainerStarted","Data":"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"}
Jul 23 01:57:11.574625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.574578    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:11.576013 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.575989    2572 generic.go:356] "Generic (PLEG): container finished" podID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerID="408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb" exitCode=0
Jul 23 01:57:11.576107 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.576035    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"
Jul 23 01:57:11.576107 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.576058    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerDied","Data":"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"}
Jul 23 01:57:11.576107 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.576100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv" event={"ID":"5b1a205f-52ad-4835-8fce-91a9ef0e68f8","Type":"ContainerDied","Data":"d94c78012f8edca37c3b2a3a9dd6fda8ed0713608c70551e13218fafbbc5450e"}
Jul 23 01:57:11.576207 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.576130    2572 scope.go:117] "RemoveContainer" containerID="408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"
Jul 23 01:57:11.584749 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.584735    2572 scope.go:117] "RemoveContainer" containerID="ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"
Jul 23 01:57:11.592407 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.592355    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" podStartSLOduration=2.043387292 podStartE2EDuration="2.592338403s" totalImagesPullingTime="548.951111ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:57:11.591699918 +0000 UTC m=+1743.340759592" watchObservedRunningTime="2026-07-23 01:57:11.592338403 +0000 UTC m=+1743.341398077"
Jul 23 01:57:11.595602 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.595587    2572 scope.go:117] "RemoveContainer" containerID="408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"
Jul 23 01:57:11.595839 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:11.595820    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb\": container with ID starting with 408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb not found: ID does not exist" containerID="408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"
Jul 23 01:57:11.595878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.595847    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb"} err="failed to get container status \"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb\": rpc error: code = NotFound desc = could not find container \"408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb\": container with ID starting with 408b6aab41f10f04097f3ebeacf392b3a89cdfa011838e77cbd1fde3546269eb not found: ID does not exist"
Jul 23 01:57:11.595878 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.595865    2572 scope.go:117] "RemoveContainer" containerID="ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"
Jul 23 01:57:11.596122 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:11.596074    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00\": container with ID starting with ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00 not found: ID does not exist" containerID="ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"
Jul 23 01:57:11.596122 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.596098    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00"} err="failed to get container status \"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00\": rpc error: code = NotFound desc = could not find container \"ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00\": container with ID starting with ff7317ecdb7fe5ac640ff72612f67cfc7310c13816e586323c4bba429ed82d00 not found: ID does not exist"
Jul 23 01:57:11.605663 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.605642    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:57:11.609845 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:11.609823    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-dafa5c71-gw-openshift-default-58b4677955-glqfv"]
Jul 23 01:57:12.754538 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:12.754507    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" path="/var/lib/kubelet/pods/5b1a205f-52ad-4835-8fce-91a9ef0e68f8/volumes"
Jul 23 01:57:17.596736 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:17.596701    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:23.559926 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.559887    2572 patch_prober.go:28] interesting pod/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 01:57:23.560341 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.559946    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 01:57:23.636857 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.636828    2572 generic.go:356] "Generic (PLEG): container finished" podID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerID="7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29" exitCode=0
Jul 23 01:57:23.637002 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.636903    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerDied","Data":"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"}
Jul 23 01:57:23.637277 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.637261    2572 scope.go:117] "RemoveContainer" containerID="7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"
Jul 23 01:57:23.638219 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.638192    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:23.638275 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.638263    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:23.638312 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:23.638298    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:24.643681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:24.643639    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerStarted","Data":"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"}
Jul 23 01:57:25.112768 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:25.112734    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:25.112971 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:25.112949    2572 patch_prober.go:28] interesting pod/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 01:57:25.113024 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:25.113009    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 01:57:26.112910 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:26.112873    2572 patch_prober.go:28] interesting pod/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 01:57:26.113317 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:26.112928    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 01:57:27.112750 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:27.112711    2572 patch_prober.go:28] interesting pod/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 01:57:27.112952 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:27.112791    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 01:57:28.113277 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:28.113235    2572 patch_prober.go:28] interesting pod/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 23 01:57:28.113785 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:28.113308    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 23 01:57:29.117704 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:29.117675    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:29.118181 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:29.118071    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:29.118708 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:29.118688    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:45.401347 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.401314    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:45.401938 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.401516    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" podUID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" containerName="maas-api" containerID="cri-o://54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00" gracePeriod=30
Jul 23 01:57:45.425625 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.425602    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:45.653274 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.653223    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:45.736258 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.736234    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7q2w\" (UniqueName: \"kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w\") pod \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") "
Jul 23 01:57:45.736430 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.736279    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca\") pod \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") "
Jul 23 01:57:45.736430 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.736359    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") pod \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\" (UID: \"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9\") "
Jul 23 01:57:45.736713 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.736689    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" (UID: "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:57:45.738397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.738376    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w" (OuterVolumeSpecName: "kube-api-access-n7q2w") pod "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" (UID: "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9"). InnerVolumeSpecName "kube-api-access-n7q2w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:45.738485 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.738387    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" (UID: "8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:57:45.750388 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.750364    2572 generic.go:356] "Generic (PLEG): container finished" podID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" containerID="54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00" exitCode=0
Jul 23 01:57:45.750510 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.750406    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"
Jul 23 01:57:45.750510 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.750454    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" event={"ID":"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9","Type":"ContainerDied","Data":"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"}
Jul 23 01:57:45.750510 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.750503    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8" event={"ID":"8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9","Type":"ContainerDied","Data":"0148f9d0f0347d2d853997d153365a410934e7d567d2407ce92ba6e782cae6f8"}
Jul 23 01:57:45.750635 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.750526    2572 scope.go:117] "RemoveContainer" containerID="54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"
Jul 23 01:57:45.758966 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.758950    2572 scope.go:117] "RemoveContainer" containerID="54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"
Jul 23 01:57:45.759240 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:45.759223    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00\": container with ID starting with 54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00 not found: ID does not exist" containerID="54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"
Jul 23 01:57:45.759291 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.759249    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00"} err="failed to get container status \"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00\": rpc error: code = NotFound desc = could not find container \"54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00\": container with ID starting with 54c0ea4943c107daff32fd8b4e75701d388f4e71a21a26a283ff587456a1cd00 not found: ID does not exist"
Jul 23 01:57:45.777497 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.777475    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:45.781383 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.781353    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-4bc37934-864c798b77-grdc8"]
Jul 23 01:57:45.837916 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.837896    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:45.838015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.837918    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7q2w\" (UniqueName: \"kubernetes.io/projected/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-kube-api-access-n7q2w\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:45.838015 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:45.837932    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:46.748587 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:46.748547    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" path="/var/lib/kubelet/pods/8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9/volumes"
Jul 23 01:57:49.825271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:49.825235    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.045850 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.045819    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:51.046256 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.046056    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy" containerID="cri-o://d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8" gracePeriod=30
Jul 23 01:57:51.067748 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.067714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.290512 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.290481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.410380 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.410352    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.521849 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.521822    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.800732 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.800659    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:57:51.800988 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.800976    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" containerName="maas-api"
Jul 23 01:57:51.801035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.800989    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" containerName="maas-api"
Jul 23 01:57:51.801035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801005    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:51.801035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801011    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:51.801035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801019    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:51.801035 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801025    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:51.801187 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801085    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bb4904e-2c6d-4ffc-ad3c-dc42fb6b7af9" containerName="maas-api"
Jul 23 01:57:51.801187 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.801093    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:51.805316 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.805301    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.808251 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.808221    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-6955f559-openshift-default-dockercfg-clrkq\""
Jul 23 01:57:51.818784 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.818760    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:57:51.827985 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.827957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:51.884603 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884725 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884629    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884725 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884657    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884725 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884693    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884725 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884932 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884932 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884932 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884809    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.884932 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.884841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqv4\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986166 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986132    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986166 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986171    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986198    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986237    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986268    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986431 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986353    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqv4\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986463    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986789 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986715    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986794    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.986905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.986877    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.987123 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.987097    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.987227 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.987190    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.988724 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.988700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.988829 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.988812    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.995738 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.995713    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:51.995856 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:51.995842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqv4\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4\") pod \"e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") " pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:52.013313 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.013288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:52.119575 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.119513    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:52.250243 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.250216    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:57:52.252651 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:57:52.252622    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4b04b2_d2af_43b5_a577_978324787df5.slice/crio-4e49d6d450f0c4c8fe604a798d6c2798a8f3df0e60d3aa0de704142e0336af9a WatchSource:0}: Error finding container 4e49d6d450f0c4c8fe604a798d6c2798a8f3df0e60d3aa0de704142e0336af9a: Status 404 returned error can't find the container with id 4e49d6d450f0c4c8fe604a798d6c2798a8f3df0e60d3aa0de704142e0336af9a
Jul 23 01:57:52.254860 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.254829    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:52.254982 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.254909    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:52.254982 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.254952    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:57:52.783364 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.783333    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerStarted","Data":"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"}
Jul 23 01:57:52.783551 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.783374    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerStarted","Data":"4e49d6d450f0c4c8fe604a798d6c2798a8f3df0e60d3aa0de704142e0336af9a"}
Jul 23 01:57:52.803905 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:52.803859    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podStartSLOduration=1.803845594 podStartE2EDuration="1.803845594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:57:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:57:52.802337509 +0000 UTC m=+1784.551397182" watchObservedRunningTime="2026-07-23 01:57:52.803845594 +0000 UTC m=+1784.552905325"
Jul 23 01:57:53.119892 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:53.119811    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:53.124697 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:53.124671    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:53.788736 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:53.788708    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:53.789574 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:53.789556    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:57:54.134879 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.134802    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:54.226072 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.226009    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:54.226669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.226651    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:57:54.227083 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.227070    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b1a205f-52ad-4835-8fce-91a9ef0e68f8" containerName="istio-proxy"
Jul 23 01:57:54.230064 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.230042    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.232284 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.232264    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-6955f559-serving-cert\""
Jul 23 01:57:54.239319 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.239299    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:57:54.291050 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.291020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:54.306244 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.306220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.306351 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.306251    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.306351 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.306291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzk2t\" (UniqueName: \"kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.407054 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.406977    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzk2t\" (UniqueName: \"kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.407227 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.407103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.407227 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.407141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.407306 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:54.407269    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-serving-cert: secret "maas-api-e2e-derive-6955f559-serving-cert" not found
Jul 23 01:57:54.407381 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:54.407370    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls podName:ad50ea84-a796-4a3a-b410-3bd676cdbc41 nodeName:}" failed. No retries permitted until 2026-07-23 01:57:54.90734863 +0000 UTC m=+1786.656408281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls") pod "maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" (UID: "ad50ea84-a796-4a3a-b410-3bd676cdbc41") : secret "maas-api-e2e-derive-6955f559-serving-cert" not found
Jul 23 01:57:54.407803 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.407785    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.417138 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.417111    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzk2t\" (UniqueName: \"kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.712572 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.712541    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:54.811658 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.811621    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:54.911180 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.911141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.913720 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.913691    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") pod \"maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:54.919396 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:54.919370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:57:55.141353 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:55.141274    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:55.277599 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:55.277577    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:57:55.280042 ip-10-0-129-17 kubenswrapper[2572]: W0723 01:57:55.280012    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad50ea84_a796_4a3a_b410_3bd676cdbc41.slice/crio-053fd232fe92e11941344487cfab9e922e31dec440c030ef951adc81f4599136 WatchSource:0}: Error finding container 053fd232fe92e11941344487cfab9e922e31dec440c030ef951adc81f4599136: Status 404 returned error can't find the container with id 053fd232fe92e11941344487cfab9e922e31dec440c030ef951adc81f4599136
Jul 23 01:57:55.798532 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:55.798498    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" event={"ID":"ad50ea84-a796-4a3a-b410-3bd676cdbc41","Type":"ContainerStarted","Data":"053fd232fe92e11941344487cfab9e922e31dec440c030ef951adc81f4599136"}
Jul 23 01:57:56.302065 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.302041    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:56.423888 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.423866    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424047 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.423926    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424047 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.423956    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424047 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424013    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424237 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424210    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424316 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424296    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l28pd\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424316 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:56.424459 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424331    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424459 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424378    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424459 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424386    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:57:56.424459 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket\") pod \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\" (UID: \"0a658af6-0f12-4af6-b62a-ef70ea47df5b\") "
Jul 23 01:57:56.424761 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424718    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:56.424761 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424734    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:56.424761 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424738    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.424964 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.424774    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.425417 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.425389    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:56.426313 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.426286    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 01:57:56.426313 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.426300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:57:56.426474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.426335    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd" (OuterVolumeSpecName: "kube-api-access-l28pd") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "kube-api-access-l28pd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:56.426474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.426386    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a658af6-0f12-4af6-b62a-ef70ea47df5b" (UID: "0a658af6-0f12-4af6-b62a-ef70ea47df5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:57:56.525611 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525589    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525611 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525610    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525619    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l28pd\" (UniqueName: \"kubernetes.io/projected/0a658af6-0f12-4af6-b62a-ef70ea47df5b-kube-api-access-l28pd\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525629    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525638    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525645    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.525731 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.525654    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a658af6-0f12-4af6-b62a-ef70ea47df5b-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:57:56.804680 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.804653    2572 generic.go:356] "Generic (PLEG): container finished" podID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerID="d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8" exitCode=0
Jul 23 01:57:56.804823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.804698    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"
Jul 23 01:57:56.804823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.804735    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerDied","Data":"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"}
Jul 23 01:57:56.804823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.804784    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5" event={"ID":"0a658af6-0f12-4af6-b62a-ef70ea47df5b","Type":"ContainerDied","Data":"8890a8f3385f555c217fe3676261a8263d93822fc02103fbc7d303f15cb7a9da"}
Jul 23 01:57:56.804823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.804815    2572 scope.go:117] "RemoveContainer" containerID="d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"
Jul 23 01:57:56.806332 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.806300    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" event={"ID":"ad50ea84-a796-4a3a-b410-3bd676cdbc41","Type":"ContainerStarted","Data":"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"}
Jul 23 01:57:56.806503 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.806488    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:57:56.813472 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.813458    2572 scope.go:117] "RemoveContainer" containerID="7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"
Jul 23 01:57:56.821588 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.821561    2572 scope.go:117] "RemoveContainer" containerID="d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"
Jul 23 01:57:56.821879 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:56.821858    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8\": container with ID starting with d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8 not found: ID does not exist" containerID="d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"
Jul 23 01:57:56.821966 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.821888    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8"} err="failed to get container status \"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8\": rpc error: code = NotFound desc = could not find container \"d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8\": container with ID starting with d31a2c363006a6be88e49870a7c2110b65b85ccad3d304e4224c037cc2d1a5d8 not found: ID does not exist"
Jul 23 01:57:56.821966 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.821905    2572 scope.go:117] "RemoveContainer" containerID="7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"
Jul 23 01:57:56.822130 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:57:56.822107    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29\": container with ID starting with 7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29 not found: ID does not exist" containerID="7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"
Jul 23 01:57:56.822190 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.822136    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29"} err="failed to get container status \"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29\": rpc error: code = NotFound desc = could not find container \"7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29\": container with ID starting with 7b60ad72737ff390b3939afd859d3855ebf4d2dafeaedc72d0c2252a3da85f29 not found: ID does not exist"
Jul 23 01:57:56.823288 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.823266    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:56.826823 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.826802    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4bc37934-openshift-default-666fd58d5c-gsrt5"]
Jul 23 01:57:56.842651 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:56.842610    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" podStartSLOduration=2.353332996 podStartE2EDuration="2.842597971s" totalImagesPullingTime="489.264975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 01:57:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 01:57:56.841277995 +0000 UTC m=+1788.590337668" watchObservedRunningTime="2026-07-23 01:57:56.842597971 +0000 UTC m=+1788.591657643"
Jul 23 01:57:58.748627 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:57:58.748599    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" path="/var/lib/kubelet/pods/0a658af6-0f12-4af6-b62a-ef70ea47df5b/volumes"
Jul 23 01:58:02.818446 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:02.818362    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:58:08.790285 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.790251    2572 patch_prober.go:28] interesting pod/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 01:58:08.790703 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.790310    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 01:58:08.826963 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.826940    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:58:08.828470 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.828447    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 01:58:08.863075 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.863041    2572 generic.go:356] "Generic (PLEG): container finished" podID="3d4b04b2-d2af-43b5-a577-978324787df5" containerID="d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825" exitCode=0
Jul 23 01:58:08.863194 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.863100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerDied","Data":"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"}
Jul 23 01:58:08.863412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.863398    2572 scope.go:117] "RemoveContainer" containerID="d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"
Jul 23 01:58:08.864384 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.864357    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:58:08.864493 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.864424    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:58:08.864493 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:08.864478    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 01:58:09.869018 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:09.868983    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerStarted","Data":"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"}
Jul 23 01:58:10.120464 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:10.120354    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:10.120621 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:10.120568    2572 patch_prober.go:28] interesting pod/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 01:58:10.120669 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:10.120642    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 01:58:11.120688 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:11.120650    2572 patch_prober.go:28] interesting pod/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 01:58:11.121077 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:11.120703    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 01:58:12.120694 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:12.120654    2572 patch_prober.go:28] interesting pod/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 01:58:12.121084 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:12.120719    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 01:58:13.120794 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:13.120757    2572 patch_prober.go:28] interesting pod/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Jul 23 01:58:13.121225 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:13.120810    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Jul 23 01:58:14.123947 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:14.123919    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:14.124424 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:14.124306    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:14.124941 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:14.124922    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:29.467178 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.467148    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:58:29.467681 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.467348    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" podUID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" containerName="maas-api" containerID="cri-o://c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc" gracePeriod=30
Jul 23 01:58:29.493176 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.493152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:29.724914 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.724848    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:58:29.823568 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.823534    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") pod \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") "
Jul 23 01:58:29.823763 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.823575    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzk2t\" (UniqueName: \"kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t\") pod \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") "
Jul 23 01:58:29.823763 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.823600    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca\") pod \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\" (UID: \"ad50ea84-a796-4a3a-b410-3bd676cdbc41\") "
Jul 23 01:58:29.823990 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.823954    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad50ea84-a796-4a3a-b410-3bd676cdbc41" (UID: "ad50ea84-a796-4a3a-b410-3bd676cdbc41"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:58:29.825697 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.825672    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t" (OuterVolumeSpecName: "kube-api-access-zzk2t") pod "ad50ea84-a796-4a3a-b410-3bd676cdbc41" (UID: "ad50ea84-a796-4a3a-b410-3bd676cdbc41"). InnerVolumeSpecName "kube-api-access-zzk2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:58:29.825786 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.825725    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad50ea84-a796-4a3a-b410-3bd676cdbc41" (UID: "ad50ea84-a796-4a3a-b410-3bd676cdbc41"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 01:58:29.924474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.924431    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad50ea84-a796-4a3a-b410-3bd676cdbc41-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:29.924474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.924469    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzk2t\" (UniqueName: \"kubernetes.io/projected/ad50ea84-a796-4a3a-b410-3bd676cdbc41-kube-api-access-zzk2t\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:29.924474 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.924479    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad50ea84-a796-4a3a-b410-3bd676cdbc41-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:29.966495 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.966464    2572 generic.go:356] "Generic (PLEG): container finished" podID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" containerID="c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc" exitCode=0
Jul 23 01:58:29.966629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.966502    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"
Jul 23 01:58:29.966629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.966524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" event={"ID":"ad50ea84-a796-4a3a-b410-3bd676cdbc41","Type":"ContainerDied","Data":"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"}
Jul 23 01:58:29.966629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.966579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb" event={"ID":"ad50ea84-a796-4a3a-b410-3bd676cdbc41","Type":"ContainerDied","Data":"053fd232fe92e11941344487cfab9e922e31dec440c030ef951adc81f4599136"}
Jul 23 01:58:29.966629 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.966601    2572 scope.go:117] "RemoveContainer" containerID="c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"
Jul 23 01:58:29.975568 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.975478    2572 scope.go:117] "RemoveContainer" containerID="c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"
Jul 23 01:58:29.975731 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:58:29.975714    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc\": container with ID starting with c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc not found: ID does not exist" containerID="c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"
Jul 23 01:58:29.975785 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.975738    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc"} err="failed to get container status \"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc\": rpc error: code = NotFound desc = could not find container \"c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc\": container with ID starting with c99d1e40673034ef69f8ca3300a2b6d82cae5c0439c20a8245f8173eb9ef20fc not found: ID does not exist"
Jul 23 01:58:29.987951 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.987927    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:58:29.992413 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:29.992393    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-6955f559-86c7449dd7-l8dxb"]
Jul 23 01:58:30.749397 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:30.749363    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" path="/var/lib/kubelet/pods/ad50ea84-a796-4a3a-b410-3bd676cdbc41/volumes"
Jul 23 01:58:33.347390 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:33.347359    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:33.447641 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:33.447610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:34.085637 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.085597    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:34.222784 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.222754    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:58:34.223007 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.222970    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy" containerID="cri-o://e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d" gracePeriod=30
Jul 23 01:58:34.248749 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.248719    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:34.510706 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.510674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:34.973339 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:34.973304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:35.068516 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:35.068484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:35.167854 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:35.167826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:36.620760 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:36.620723    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:39.479303 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.479280    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:39.504719 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504653    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504719 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504693    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504723    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504739    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504855    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504886    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.504921 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504909    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.505241 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.504931    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfqv4\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4\") pod \"3d4b04b2-d2af-43b5-a577-978324787df5\" (UID: \"3d4b04b2-d2af-43b5-a577-978324787df5\") "
Jul 23 01:58:39.505241 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505024    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:58:39.505241 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505112    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 01:58:39.505412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505322    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:58:39.505412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505381    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.505412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505400    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d4b04b2-d2af-43b5-a577-978324787df5-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.505412 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505114    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:58:39.505662 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.505580    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data" (OuterVolumeSpecName: "istio-data") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:58:39.507324 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.507300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 01:58:39.507542 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.507516    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 01:58:39.507638 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.507560    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4" (OuterVolumeSpecName: "kube-api-access-mfqv4") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "kube-api-access-mfqv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:58:39.507638 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.507575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token" (OuterVolumeSpecName: "istio-token") pod "3d4b04b2-d2af-43b5-a577-978324787df5" (UID: "3d4b04b2-d2af-43b5-a577-978324787df5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 01:58:39.606168 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606134    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606168 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606162    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606168 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606171    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606168 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606180    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606189    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfqv4\" (UniqueName: \"kubernetes.io/projected/3d4b04b2-d2af-43b5-a577-978324787df5-kube-api-access-mfqv4\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606198    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d4b04b2-d2af-43b5-a577-978324787df5-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:39.606536 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:39.606208    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d4b04b2-d2af-43b5-a577-978324787df5-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 01:58:40.017770 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.017734    2572 generic.go:356] "Generic (PLEG): container finished" podID="3d4b04b2-d2af-43b5-a577-978324787df5" containerID="e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d" exitCode=0
Jul 23 01:58:40.017922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.017778    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"
Jul 23 01:58:40.017922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.017777    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerDied","Data":"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"}
Jul 23 01:58:40.017922 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.017898    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg" event={"ID":"3d4b04b2-d2af-43b5-a577-978324787df5","Type":"ContainerDied","Data":"4e49d6d450f0c4c8fe604a798d6c2798a8f3df0e60d3aa0de704142e0336af9a"}
Jul 23 01:58:40.018105 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.017925    2572 scope.go:117] "RemoveContainer" containerID="e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"
Jul 23 01:58:40.027513 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.027497    2572 scope.go:117] "RemoveContainer" containerID="d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"
Jul 23 01:58:40.035392 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.035373    2572 scope.go:117] "RemoveContainer" containerID="e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"
Jul 23 01:58:40.035736 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:58:40.035717    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d\": container with ID starting with e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d not found: ID does not exist" containerID="e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"
Jul 23 01:58:40.035786 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.035745    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d"} err="failed to get container status \"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d\": rpc error: code = NotFound desc = could not find container \"e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d\": container with ID starting with e20e4b1b38f171bbde1a5b9c5d53851e84eb51195c617c8ac079c947dac4214d not found: ID does not exist"
Jul 23 01:58:40.035786 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.035764    2572 scope.go:117] "RemoveContainer" containerID="d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"
Jul 23 01:58:40.036025 ip-10-0-129-17 kubenswrapper[2572]: E0723 01:58:40.036007    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825\": container with ID starting with d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825 not found: ID does not exist" containerID="d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"
Jul 23 01:58:40.036064 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.036030    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825"} err="failed to get container status \"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825\": rpc error: code = NotFound desc = could not find container \"d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825\": container with ID starting with d61bb9dc38d7a6193ab3b8877cd82a1801ee78e74d2d58b7fa2d965d41238825 not found: ID does not exist"
Jul 23 01:58:40.040391 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.040370    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:58:40.043992 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.043972    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-6955f559-openshift-default-6bf8ffd887-vsjxg"]
Jul 23 01:58:40.749156 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:40.749127    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" path="/var/lib/kubelet/pods/3d4b04b2-d2af-43b5-a577-978324787df5/volumes"
Jul 23 01:58:42.493349 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:42.493307    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:42.552838 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:42.552813    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:42.626113 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:42.626065    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:42.722972 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:42.722928    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:42.823549 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:42.823460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:58:43.171583 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:58:43.171552    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:09.143165 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:09.143120    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:15.434014 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:15.433979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:15.540290 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:15.540263    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:15.639271 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:15.639239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:31.497132 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:31.497047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:37.089585 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:37.089548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:37.149748 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:37.149720    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:37.233383 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:37.233358    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:37.331514 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:37.331489    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:47.794238 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:47.794208    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:48.602771 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:48.602734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:54.962579 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:54.962540    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:55.069054 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:55.069022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:55.162711 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:55.162682    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:55.262478 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:55.262353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:56.060155 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:56.060121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:56.249059 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:56.249023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:56.920923 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:56.920897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 01:59:57.866307 ip-10-0-129-17 kubenswrapper[2572]: I0723 01:59:57.866242    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:00.141796 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.141761    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"]
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142111    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142123    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142140    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142145    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142152    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142158    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142165    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.142174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142170    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142180    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" containerName="maas-api"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142185    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" containerName="maas-api"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142245    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142254    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a658af6-0f12-4af6-b62a-ef70ea47df5b" containerName="istio-proxy"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142262    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad50ea84-a796-4a3a-b410-3bd676cdbc41" containerName="maas-api"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142267    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.142420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.142273    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d4b04b2-d2af-43b5-a577-978324787df5" containerName="istio-proxy"
Jul 23 02:00:00.145151 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.145136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"
Jul 23 02:00:00.147378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.147356    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-l5l5h\""
Jul 23 02:00:00.151913 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.151880    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"]
Jul 23 02:00:00.156270 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.156251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"
Jul 23 02:00:00.296555 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.296526    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"]
Jul 23 02:00:00.300392 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:00:00.300360    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acaa8db_cbca_43b2_8863_c04f2c694754.slice/crio-b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97 WatchSource:0}: Error finding container b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97: Status 404 returned error can't find the container with id b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97
Jul 23 02:00:00.392145 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:00.392059    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq" event={"ID":"1acaa8db-cbca-43b2-8863-c04f2c694754","Type":"ContainerStarted","Data":"b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97"}
Jul 23 02:00:03.407345 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:03.407310    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq" event={"ID":"1acaa8db-cbca-43b2-8863-c04f2c694754","Type":"ContainerStarted","Data":"885f7b070cd27f84c22bab4532698413b97e50e613cf6aae23dbfc65be5384c3"}
Jul 23 02:00:03.423605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:03.423558    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq" podStartSLOduration=0.769021466 podStartE2EDuration="3.423544358s" totalImagesPullingTime="2.654522892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:00:03.422654522 +0000 UTC m=+1915.171714194" watchObservedRunningTime="2026-07-23 02:00:03.423544358 +0000 UTC m=+1915.172604029"
Jul 23 02:00:03.617673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:03.617584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:04.237712 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:04.237669    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:04.413302 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:04.413267    2572 generic.go:356] "Generic (PLEG): container finished" podID="1acaa8db-cbca-43b2-8863-c04f2c694754" containerID="885f7b070cd27f84c22bab4532698413b97e50e613cf6aae23dbfc65be5384c3" exitCode=0
Jul 23 02:00:04.413779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:04.413351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq" event={"ID":"1acaa8db-cbca-43b2-8863-c04f2c694754","Type":"ContainerDied","Data":"885f7b070cd27f84c22bab4532698413b97e50e613cf6aae23dbfc65be5384c3"}
Jul 23 02:00:05.554571 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:05.554549    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"
Jul 23 02:00:06.423492 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:06.423459    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq"
Jul 23 02:00:06.423679 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:06.423500    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746200-jjjgq" event={"ID":"1acaa8db-cbca-43b2-8863-c04f2c694754","Type":"ContainerDied","Data":"b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97"}
Jul 23 02:00:06.423679 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:06.423556    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b43c5ed4047c4700d8caf282e038218ad511e785b786ee6e593433abf1a7dd97"
Jul 23 02:00:07.391144 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:07.391116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:10.223754 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.223704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:10.325955 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.325913    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:10.745455 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.744296    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:10.745455 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.744837    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1acaa8db-cbca-43b2-8863-c04f2c694754" containerName="cleanup"
Jul 23 02:00:10.745455 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.744856    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1acaa8db-cbca-43b2-8863-c04f2c694754" containerName="cleanup"
Jul 23 02:00:10.745455 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.744964    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1acaa8db-cbca-43b2-8863-c04f2c694754" containerName="cleanup"
Jul 23 02:00:10.749929 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.749829    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.752625 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.752604    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bcbcd8ed-openshift-default-dockercfg-mjst9\""
Jul 23 02:00:10.763094 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.763065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:10.866712 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866673    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lgdc\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.866897 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866726    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.866897 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866784    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.866897 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866809    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.866897 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866843    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.867073 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.867073 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.866958    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.867073 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.867011    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.867073 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.867045    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.875993 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.875957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:10.968013 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.967976    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968013 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968020    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968246 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968246 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lgdc\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968246 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968241    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968414 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968280    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968414 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968414 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968414 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968379    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968680 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968528    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968680 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968591    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968714    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.968791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968777    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.969012 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.968992    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.970369 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.970349    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.970684 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.970668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.978174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.978141    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:10.978809 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.978786    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:10.979022 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:10.978999    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lgdc\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc\") pod \"e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") " pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:11.062812 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.062741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:11.209710 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.209674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:11.252462 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.252410    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:11.253813 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:00:11.253789    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29a07fd_8fef_4f7f_aa3f_1cbd42c03095.slice/crio-2ebf8b49b09eb120e4cadf15e3a88648c49cdab48f1b168a9d0ca969f560cc1b WatchSource:0}: Error finding container 2ebf8b49b09eb120e4cadf15e3a88648c49cdab48f1b168a9d0ca969f560cc1b: Status 404 returned error can't find the container with id 2ebf8b49b09eb120e4cadf15e3a88648c49cdab48f1b168a9d0ca969f560cc1b
Jul 23 02:00:11.256701 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.256662    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:11.256795 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.256745    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:11.256795 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.256783    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:11.448955 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.448922    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerStarted","Data":"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"}
Jul 23 02:00:11.449148 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.448977    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerStarted","Data":"2ebf8b49b09eb120e4cadf15e3a88648c49cdab48f1b168a9d0ca969f560cc1b"}
Jul 23 02:00:11.477522 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:11.477458    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podStartSLOduration=1.4774191509999999 podStartE2EDuration="1.477419151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:00:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:00:11.47460315 +0000 UTC m=+1923.223662823" watchObservedRunningTime="2026-07-23 02:00:11.477419151 +0000 UTC m=+1923.226478826"
Jul 23 02:00:12.065474 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:12.065033    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:12.065474 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:12.065156    2572 patch_prober.go:28] interesting pod/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 23 02:00:12.065474 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:12.065199    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 23 02:00:13.067672 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.067642    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:13.459144 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.459108    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:13.459934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.459914    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:13.557204 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.557173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:13.649719 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.649690    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:13.686474 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.686419    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:13.689819 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.689800    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.692964 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.692942    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-bcbcd8ed-serving-cert\""
Jul 23 02:00:13.703152 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.703128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:13.752329 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.752267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:13.794952 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.794926    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.795092 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.794996    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.795092 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.795084    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgcj\" (UniqueName: \"kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.895762 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.895736    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.895894 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.895778    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.895894 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.895847    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgcj\" (UniqueName: \"kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.896018 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:00:13.895892    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-serving-cert: secret "maas-api-e2e-mt-bcbcd8ed-serving-cert" not found
Jul 23 02:00:13.896018 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:00:13.895980    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls podName:b9e70c0c-5fdb-4a73-850a-2d48f59c0575 nodeName:}" failed. No retries permitted until 2026-07-23 02:00:14.395957467 +0000 UTC m=+1926.145017132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls") pod "maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" (UID: "b9e70c0c-5fdb-4a73-850a-2d48f59c0575") : secret "maas-api-e2e-mt-bcbcd8ed-serving-cert" not found
Jul 23 02:00:13.896493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.896479    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:13.904334 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:13.904307    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgcj\" (UniqueName: \"kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:14.287892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.287856    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:14.390742 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.390711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:14.399739 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.399715    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:14.402073 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.402048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") pod \"maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:14.492841 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.492808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:14.600975 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.600877    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:14.739756 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:14.739733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:14.741552 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:00:14.741525    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e70c0c_5fdb_4a73_850a_2d48f59c0575.slice/crio-8cb4703060f76bd684d43b001ea3b5763092712d017bd8c3e942730dafb00bff WatchSource:0}: Error finding container 8cb4703060f76bd684d43b001ea3b5763092712d017bd8c3e942730dafb00bff: Status 404 returned error can't find the container with id 8cb4703060f76bd684d43b001ea3b5763092712d017bd8c3e942730dafb00bff
Jul 23 02:00:15.468987 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:15.468963    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" event={"ID":"b9e70c0c-5fdb-4a73-850a-2d48f59c0575","Type":"ContainerStarted","Data":"8cb4703060f76bd684d43b001ea3b5763092712d017bd8c3e942730dafb00bff"}
Jul 23 02:00:16.475081 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:16.475047    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" event={"ID":"b9e70c0c-5fdb-4a73-850a-2d48f59c0575","Type":"ContainerStarted","Data":"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"}
Jul 23 02:00:16.475519 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:16.475110    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:16.495873 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:16.495830    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" podStartSLOduration=2.782039788 podStartE2EDuration="3.495814236s" totalImagesPullingTime="713.774448ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:00:16.494408847 +0000 UTC m=+1928.243468521" watchObservedRunningTime="2026-07-23 02:00:16.495814236 +0000 UTC m=+1928.244873943"
Jul 23 02:00:17.959347 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:17.959311    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:18.600947 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:18.600919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:18.701676 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:18.701641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:19.011459 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:19.011407    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:22.489448 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:22.489416    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:24.521984 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.521948    2572 generic.go:356] "Generic (PLEG): container finished" podID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerID="e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54" exitCode=0
Jul 23 02:00:24.522540 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.522023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerDied","Data":"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"}
Jul 23 02:00:24.522540 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.522379    2572 scope.go:117] "RemoveContainer" containerID="e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"
Jul 23 02:00:24.523369 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.523335    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:24.523547 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.523402    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:24.523547 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.523456    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:00:24.898091 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.898011    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:24.998708 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:24.998674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:25.528182 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:25.528149    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerStarted","Data":"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"}
Jul 23 02:00:26.063610 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:26.063571    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:26.064749 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:26.064724    2572 patch_prober.go:28] interesting pod/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 23 02:00:26.064881 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:26.064782    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 23 02:00:27.063375 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:27.063341    2572 patch_prober.go:28] interesting pod/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 23 02:00:27.063865 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:27.063401    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 23 02:00:28.063768 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:28.063734    2572 patch_prober.go:28] interesting pod/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 23 02:00:28.064157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:28.063798    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 23 02:00:28.459535 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:28.459502    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:29.063200 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:29.063161    2572 patch_prober.go:28] interesting pod/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body=
Jul 23 02:00:29.063373 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:29.063220    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused"
Jul 23 02:00:30.066971 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:30.066943    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:30.068087 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:30.068065    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:35.829881 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:35.829849    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:35.830354 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:35.830122    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" podUID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" containerName="maas-api" containerID="cri-o://db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac" gracePeriod=30
Jul 23 02:00:35.988368 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:35.988323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:36.080371 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.080318    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:36.188874 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.188847    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca\") pod \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") "
Jul 23 02:00:36.189020 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.188896    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") pod \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") "
Jul 23 02:00:36.189020 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.188944    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqgcj\" (UniqueName: \"kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj\") pod \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\" (UID: \"b9e70c0c-5fdb-4a73-850a-2d48f59c0575\") "
Jul 23 02:00:36.189206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.189182    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9e70c0c-5fdb-4a73-850a-2d48f59c0575" (UID: "b9e70c0c-5fdb-4a73-850a-2d48f59c0575"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:00:36.190865 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.190838    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9e70c0c-5fdb-4a73-850a-2d48f59c0575" (UID: "b9e70c0c-5fdb-4a73-850a-2d48f59c0575"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:00:36.190964 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.190894    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj" (OuterVolumeSpecName: "kube-api-access-qqgcj") pod "b9e70c0c-5fdb-4a73-850a-2d48f59c0575" (UID: "b9e70c0c-5fdb-4a73-850a-2d48f59c0575"). InnerVolumeSpecName "kube-api-access-qqgcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:00:36.289823 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.289796    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:36.289823 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.289818    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:36.289823 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.289827    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqgcj\" (UniqueName: \"kubernetes.io/projected/b9e70c0c-5fdb-4a73-850a-2d48f59c0575-kube-api-access-qqgcj\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:36.585688 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.585654    2572 generic.go:356] "Generic (PLEG): container finished" podID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" containerID="db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac" exitCode=0
Jul 23 02:00:36.585688 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.585692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" event={"ID":"b9e70c0c-5fdb-4a73-850a-2d48f59c0575","Type":"ContainerDied","Data":"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"}
Jul 23 02:00:36.585934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.585722    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"
Jul 23 02:00:36.585934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.585753    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5" event={"ID":"b9e70c0c-5fdb-4a73-850a-2d48f59c0575","Type":"ContainerDied","Data":"8cb4703060f76bd684d43b001ea3b5763092712d017bd8c3e942730dafb00bff"}
Jul 23 02:00:36.585934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.585775    2572 scope.go:117] "RemoveContainer" containerID="db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"
Jul 23 02:00:36.595186 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.595169    2572 scope.go:117] "RemoveContainer" containerID="db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"
Jul 23 02:00:36.595464 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:00:36.595421    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac\": container with ID starting with db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac not found: ID does not exist" containerID="db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"
Jul 23 02:00:36.595562 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.595473    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac"} err="failed to get container status \"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac\": rpc error: code = NotFound desc = could not find container \"db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac\": container with ID starting with db77f2922208926bcd9192d5163a3bdd4ec5ab4ec54729e1d43e3acc02aa40ac not found: ID does not exist"
Jul 23 02:00:36.607581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.607556    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:36.610846 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.610828    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-bcbcd8ed-5648bc55f6-5phr5"]
Jul 23 02:00:36.749381 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:36.749354    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" path="/var/lib/kubelet/pods/b9e70c0c-5fdb-4a73-850a-2d48f59c0575/volumes"
Jul 23 02:00:40.314526 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:40.314462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:40.472092 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:40.472056    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:40.683889 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:40.683860    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:46.442628 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.442594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:46.513172 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.513150    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:46.683686 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.683653    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:46.683914 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.683884    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy" containerID="cri-o://4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87" gracePeriod=30
Jul 23 02:00:46.705409 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.705325    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:46.975474 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:46.975372    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:47.149659 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:47.149628    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:47.249322 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:47.249259    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:47.348420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:47.348393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:51.948524 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:51.948461    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:52.020532 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020504    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020694 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020694 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020604    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020694 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020629    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020694 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020666    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020717    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020783    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lgdc\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020821    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.020918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020857    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo\") pod \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\" (UID: \"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095\") "
Jul 23 02:00:52.021093 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020905    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:00:52.021093 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020989    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:00:52.021093 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.020999    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:00:52.021228 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.021198    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.021298 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.021236    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.021351 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.021297    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.021351 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.021328    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:00:52.021666 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.021640    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data" (OuterVolumeSpecName: "istio-data") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:00:52.022860 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.022831    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token" (OuterVolumeSpecName: "istio-token") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:00:52.022987 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.022966    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:00:52.023054 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.023018    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc" (OuterVolumeSpecName: "kube-api-access-4lgdc") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "kube-api-access-4lgdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:00:52.023095 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.023074    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" (UID: "a29a07fd-8fef-4f7f-aa3f-1cbd42c03095"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:00:52.122495 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122457    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.122495 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122493    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.122495 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122502    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.122696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122512    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lgdc\" (UniqueName: \"kubernetes.io/projected/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-kube-api-access-4lgdc\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.122696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122522    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.122696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.122530    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:00:52.665396 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.665361    2572 generic.go:356] "Generic (PLEG): container finished" podID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerID="4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87" exitCode=0
Jul 23 02:00:52.665581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.665409    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"
Jul 23 02:00:52.665581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.665417    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerDied","Data":"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"}
Jul 23 02:00:52.665581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.665486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6" event={"ID":"a29a07fd-8fef-4f7f-aa3f-1cbd42c03095","Type":"ContainerDied","Data":"2ebf8b49b09eb120e4cadf15e3a88648c49cdab48f1b168a9d0ca969f560cc1b"}
Jul 23 02:00:52.665581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.665509    2572 scope.go:117] "RemoveContainer" containerID="4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"
Jul 23 02:00:52.674511 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.674488    2572 scope.go:117] "RemoveContainer" containerID="e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"
Jul 23 02:00:52.681781 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.681765    2572 scope.go:117] "RemoveContainer" containerID="4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"
Jul 23 02:00:52.682022 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:00:52.682004    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87\": container with ID starting with 4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87 not found: ID does not exist" containerID="4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"
Jul 23 02:00:52.682067 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.682029    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87"} err="failed to get container status \"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87\": rpc error: code = NotFound desc = could not find container \"4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87\": container with ID starting with 4a0a2b5ec67b28ef97f31b0d0f6e6e61e32a859b156e062c92be4f888b33bf87 not found: ID does not exist"
Jul 23 02:00:52.682067 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.682044    2572 scope.go:117] "RemoveContainer" containerID="e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"
Jul 23 02:00:52.682268 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:00:52.682249    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54\": container with ID starting with e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54 not found: ID does not exist" containerID="e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"
Jul 23 02:00:52.682319 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.682272    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54"} err="failed to get container status \"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54\": rpc error: code = NotFound desc = could not find container \"e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54\": container with ID starting with e3cf1194df3a06e226977657fb9f74166991d9ac477a034320c1b7105f737a54 not found: ID does not exist"
Jul 23 02:00:52.687454 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.687415    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:52.691795 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.691775    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bcbcd8ed-openshift-default-64dcf8b7dc-bhdz6"]
Jul 23 02:00:52.748331 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.748310    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" path="/var/lib/kubelet/pods/a29a07fd-8fef-4f7f-aa3f-1cbd42c03095/volumes"
Jul 23 02:00:52.982960 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:52.982896    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:53.042653 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:53.042631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:53.121178 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:53.121152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:53.221091 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:53.221061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:53.329927 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:53.329840    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:58.308862 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:58.308820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:59.017917 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:59.017879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:00:59.085265 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:00:59.085224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:05.784764 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:05.784691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:06.052251 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052174    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:01:06.052542 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052529    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:06.052594 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052544    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:06.052594 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052568    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" containerName="maas-api"
Jul 23 02:01:06.052594 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052573    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" containerName="maas-api"
Jul 23 02:01:06.052703 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052627    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e70c0c-5fdb-4a73-850a-2d48f59c0575" containerName="maas-api"
Jul 23 02:01:06.052703 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052637    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:06.052703 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.052643    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:06.057127 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.057111    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.059746 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.059721    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6d207b89-openshift-default-dockercfg-knwjs\""
Jul 23 02:01:06.076411 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.076389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:01:06.091529 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.091505    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:06.145945 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.145913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.145945 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.145952    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146256 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.145983    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjgn\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146256 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146256 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146256 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146197    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146515 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146515 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.146515 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.146356    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.220326 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.220282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:06.247021 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.246996    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247150 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247024    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247150 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247052    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247150 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247078    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247150 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247150 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjgn\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247396 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247170    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247487 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247470    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247550 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247199    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247609 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247592    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247665 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247621    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247718 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247683    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247932 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247900    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.247932 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.247920    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.249450 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.249416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.249700 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.249679    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.255661 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.255641    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.255935 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.255917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjgn\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn\") pod \"e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") " pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.366786 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.366716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:06.500481 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.500452    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:01:06.503257 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:01:06.503223    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2c0f9ea_8a4b_4089_af64_d5f017d48613.slice/crio-375784aa5853a56a6e783e01751be61a991800a786b9e33c64dcc65cbda0a9f1 WatchSource:0}: Error finding container 375784aa5853a56a6e783e01751be61a991800a786b9e33c64dcc65cbda0a9f1: Status 404 returned error can't find the container with id 375784aa5853a56a6e783e01751be61a991800a786b9e33c64dcc65cbda0a9f1
Jul 23 02:01:06.505804 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.505773    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:06.505921 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.505850    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:06.505921 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.505893    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:06.729890 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.729849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerStarted","Data":"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"}
Jul 23 02:01:06.730094 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.729916    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerStarted","Data":"375784aa5853a56a6e783e01751be61a991800a786b9e33c64dcc65cbda0a9f1"}
Jul 23 02:01:06.746467 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:06.746399    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podStartSLOduration=0.746382658 podStartE2EDuration="746.382658ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:01:06.745778552 +0000 UTC m=+1978.494838239" watchObservedRunningTime="2026-07-23 02:01:06.746382658 +0000 UTC m=+1978.495442332"
Jul 23 02:01:07.367302 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:07.367270    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:07.372100 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:07.372078    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:07.734801 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:07.734777    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:07.735584 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:07.735566    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:08.702186 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.702151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:08.760295 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.760254    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:08.760638 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.760623    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:08.760638 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.760639    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a29a07fd-8fef-4f7f-aa3f-1cbd42c03095" containerName="istio-proxy"
Jul 23 02:01:08.763857 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.763836    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.766364 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.766341    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6d207b89-serving-cert\""
Jul 23 02:01:08.774501 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.774480    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:08.793664 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.793639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:08.867339 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.867300    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.867339 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.867342    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.867622 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.867584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7z84\" (UniqueName: \"kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.968887 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.968824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z84\" (UniqueName: \"kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.968997 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.968887    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.968997 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.968925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.969480 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.969429    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.971365 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.971345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:08.980815 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:08.980796    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7z84\" (UniqueName: \"kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84\") pod \"maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:09.074606 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.074583    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:09.082677 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.082656    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:09.185021 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.184993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:09.202844 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.202823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:09.203936 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:01:09.203910    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a2c205_12a6_4e8c_be9a_c0e87cd16bfe.slice/crio-7d290f8040fb947c3259d4f65e1f73c07e44c12c2fc84b8c801900a441abc290 WatchSource:0}: Error finding container 7d290f8040fb947c3259d4f65e1f73c07e44c12c2fc84b8c801900a441abc290: Status 404 returned error can't find the container with id 7d290f8040fb947c3259d4f65e1f73c07e44c12c2fc84b8c801900a441abc290
Jul 23 02:01:09.205223 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.205207    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 02:01:09.346505 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.346392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:09.447937 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.447898    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:09.745255 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.745222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" event={"ID":"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe","Type":"ContainerStarted","Data":"c4b3b681cba5f57eb6977283723f4af98132edd2f08ac63d8dd7d30ff200e9cb"}
Jul 23 02:01:09.745255 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.745267    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" event={"ID":"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe","Type":"ContainerStarted","Data":"7d290f8040fb947c3259d4f65e1f73c07e44c12c2fc84b8c801900a441abc290"}
Jul 23 02:01:09.745784 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.745428    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:09.765021 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:09.764977    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" podStartSLOduration=1.475530663 podStartE2EDuration="1.764963487s" totalImagesPullingTime="289.432824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:01:09.763305794 +0000 UTC m=+1981.512365478" watchObservedRunningTime="2026-07-23 02:01:09.764963487 +0000 UTC m=+1981.514023158"
Jul 23 02:01:13.165475 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:13.165423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:15.756381 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:15.756352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:21.296214 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.296178    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:21.813877 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.813849    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerID="162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443" exitCode=0
Jul 23 02:01:21.814072 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.813926    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerDied","Data":"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"}
Jul 23 02:01:21.814344 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.814322    2572 scope.go:117] "RemoveContainer" containerID="162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"
Jul 23 02:01:21.815462 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.815416    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:21.815534 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.815519    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:21.815582 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:21.815567    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:01:22.734925 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:22.734885    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:22.821061 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:22.821020    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerStarted","Data":"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"}
Jul 23 02:01:23.367714 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:23.367681    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:23.368779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:23.368750    2572 patch_prober.go:28] interesting pod/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 02:01:23.368912 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:23.368800    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 02:01:24.367757 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:24.367720    2572 patch_prober.go:28] interesting pod/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 02:01:24.368144 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:24.367793    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 02:01:25.367961 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:25.367922    2572 patch_prober.go:28] interesting pod/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 02:01:25.368462 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:25.368000    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 02:01:26.367288 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:26.367248    2572 patch_prober.go:28] interesting pod/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Jul 23 02:01:26.367629 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:26.367346    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Jul 23 02:01:27.371227 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:27.371181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:27.371706 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:27.371689    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:27.372284 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:27.372266    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:01:56.750892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:56.750854    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:56.751381 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:56.751097    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" podUID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" containerName="maas-api" containerID="cri-o://c4b3b681cba5f57eb6977283723f4af98132edd2f08ac63d8dd7d30ff200e9cb" gracePeriod=30
Jul 23 02:01:56.767280 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:56.767253    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:01:56.982125 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:56.982090    2572 generic.go:356] "Generic (PLEG): container finished" podID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" containerID="c4b3b681cba5f57eb6977283723f4af98132edd2f08ac63d8dd7d30ff200e9cb" exitCode=0
Jul 23 02:01:56.982366 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:56.982251    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" event={"ID":"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe","Type":"ContainerDied","Data":"c4b3b681cba5f57eb6977283723f4af98132edd2f08ac63d8dd7d30ff200e9cb"}
Jul 23 02:01:57.004768 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.004718    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:57.073970 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.073944    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca\") pod \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") "
Jul 23 02:01:57.074119 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.074034    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7z84\" (UniqueName: \"kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84\") pod \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") "
Jul 23 02:01:57.074119 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.074082    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls\") pod \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\" (UID: \"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe\") "
Jul 23 02:01:57.074313 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.074291    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" (UID: "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:01:57.076088 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.076059    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84" (OuterVolumeSpecName: "kube-api-access-q7z84") pod "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" (UID: "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe"). InnerVolumeSpecName "kube-api-access-q7z84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:01:57.076188 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.076168    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" (UID: "09a2c205-12a6-4e8c-be9a-c0e87cd16bfe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:01:57.175331 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.175304    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:01:57.175464 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.175343    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:01:57.175464 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.175353    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7z84\" (UniqueName: \"kubernetes.io/projected/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe-kube-api-access-q7z84\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:01:57.988257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.988228    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"
Jul 23 02:01:57.988257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.988241    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m" event={"ID":"09a2c205-12a6-4e8c-be9a-c0e87cd16bfe","Type":"ContainerDied","Data":"7d290f8040fb947c3259d4f65e1f73c07e44c12c2fc84b8c801900a441abc290"}
Jul 23 02:01:57.988728 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:57.988301    2572 scope.go:117] "RemoveContainer" containerID="c4b3b681cba5f57eb6977283723f4af98132edd2f08ac63d8dd7d30ff200e9cb"
Jul 23 02:01:58.028918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:58.028888    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:58.037076 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:58.037056    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d207b89-6fc57b8c95-nn92m"]
Jul 23 02:01:58.750020 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:01:58.749988    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" path="/var/lib/kubelet/pods/09a2c205-12a6-4e8c-be9a-c0e87cd16bfe/volumes"
Jul 23 02:02:01.376035 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:01.376004    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:03.539099 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:03.539069    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:09.290835 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:09.290725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:33.291244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:33.291118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:44.843080 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:44.843049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:45.473093 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:45.473062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:50.907558 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:50.907501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:51.173531 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:51.173501    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:02:51.173754 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:51.173731    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy" containerID="cri-o://cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2" gracePeriod=30
Jul 23 02:02:52.210291 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:52.210239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:52.324237 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:52.324194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:52.442791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:52.442759    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:52.546212 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:52.546144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:52.648555 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:52.648521    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:53.378022 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:53.377995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:53.514976 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:53.514946    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:54.874830 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:54.874774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:02:56.428035 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.428007    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:02:56.583257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583171    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583235    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583255    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583279    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583315    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583336    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583384    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdjgn\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583423    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583579 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583484    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token\") pod \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\" (UID: \"d2c0f9ea-8a4b-4089-af64-d5f017d48613\") "
Jul 23 02:02:56.583892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583641    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:02:56.583892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583646    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:02:56.583892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583640    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:02:56.583892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583881    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:02:56.584111 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583907    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.584111 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583928    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.584111 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.583943    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.584259 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.584190    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:02:56.585889 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.585865    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:02:56.585889 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.585865    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:02:56.586063 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.585890    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn" (OuterVolumeSpecName: "kube-api-access-sdjgn") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "kube-api-access-sdjgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:02:56.586289 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.586269    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2c0f9ea-8a4b-4089-af64-d5f017d48613" (UID: "d2c0f9ea-8a4b-4089-af64-d5f017d48613"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:02:56.684945 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684903    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdjgn\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-kube-api-access-sdjgn\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.684945 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684930    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.684945 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684953    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.685250 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684962    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.685250 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684970    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:56.685250 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:56.684977    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2c0f9ea-8a4b-4089-af64-d5f017d48613-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:02:57.275206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.275170    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerID="cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2" exitCode=0
Jul 23 02:02:57.275408 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.275232    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"
Jul 23 02:02:57.275408 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.275264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerDied","Data":"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"}
Jul 23 02:02:57.275408 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.275334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5" event={"ID":"d2c0f9ea-8a4b-4089-af64-d5f017d48613","Type":"ContainerDied","Data":"375784aa5853a56a6e783e01751be61a991800a786b9e33c64dcc65cbda0a9f1"}
Jul 23 02:02:57.275408 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.275364    2572 scope.go:117] "RemoveContainer" containerID="cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"
Jul 23 02:02:57.284645 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.284626    2572 scope.go:117] "RemoveContainer" containerID="162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"
Jul 23 02:02:57.292824 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.292645    2572 scope.go:117] "RemoveContainer" containerID="cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"
Jul 23 02:02:57.292926 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:02:57.292908    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2\": container with ID starting with cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2 not found: ID does not exist" containerID="cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"
Jul 23 02:02:57.292972 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.292933    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2"} err="failed to get container status \"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2\": rpc error: code = NotFound desc = could not find container \"cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2\": container with ID starting with cbf4d18c4dbfb628e46ff30180cca70639311b964e4ecfbafed1f7cab79a4de2 not found: ID does not exist"
Jul 23 02:02:57.292972 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.292952    2572 scope.go:117] "RemoveContainer" containerID="162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"
Jul 23 02:02:57.293202 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:02:57.293179    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443\": container with ID starting with 162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443 not found: ID does not exist" containerID="162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"
Jul 23 02:02:57.293300 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.293206    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443"} err="failed to get container status \"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443\": rpc error: code = NotFound desc = could not find container \"162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443\": container with ID starting with 162411da0806971d0a4c3d5672bc8ee756b10dd8ff0480b0610e77afed5e8443 not found: ID does not exist"
Jul 23 02:02:57.294017 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.293994    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:02:57.296977 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:57.296956    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6d207b89-openshift-default-dc9c5b8f9-nchs5"]
Jul 23 02:02:58.748382 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:02:58.748350    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" path="/var/lib/kubelet/pods/d2c0f9ea-8a4b-4089-af64-d5f017d48613/volumes"
Jul 23 02:03:00.811941 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:00.811905    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:00.882241 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:00.882214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:01.469783 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:01.469748    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:07.627139 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:07.627094    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:07.734164 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:07.734122    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:07.834911 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:07.834882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:08.854277 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:08.854249    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:03:08.859731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:08.859712    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:03:18.367613 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:18.367577    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:18.766195 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:18.766163    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:34.127908 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:34.127872    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:34.226934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:34.226905    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:39.684777 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:39.684744    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:45.870907 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:45.870866    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:45.972303 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:45.972267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:46.234329 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.234293    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:46.530783 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.530702    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:03:46.531110 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531096    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.531159 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531111    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.531159 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531121    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" containerName="maas-api"
Jul 23 02:03:46.531159 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531126    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" containerName="maas-api"
Jul 23 02:03:46.531159 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531137    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.531159 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531143    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.531311 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531197    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.531311 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531204    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="09a2c205-12a6-4e8c-be9a-c0e87cd16bfe" containerName="maas-api"
Jul 23 02:03:46.531311 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.531212    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2c0f9ea-8a4b-4089-af64-d5f017d48613" containerName="istio-proxy"
Jul 23 02:03:46.533580 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.533560    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.536001 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.535977    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-99eab2-openshift-default-dockercfg-fkgqh\""
Jul 23 02:03:46.545915 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.545887    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:03:46.555152 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.555128    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:46.597842 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.597804    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598016 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.597909    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598016 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.597951    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598016 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.597969    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598016 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.597986    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.598027    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kq9k\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.598072    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.598094    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.598157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.598146    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698792 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698755    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698801    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698871    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698903    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698926    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kq9k\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.698981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.698948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699387 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699387 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699542 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699603 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699583    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699688 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.699807 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.699717    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.701313 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.701292    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.701541 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.701521    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.707261 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.707238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kq9k\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.707325 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.707275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token\") pod \"e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") " pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.847777 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.847688    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:46.885373 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:46.885337    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:47.003827 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.003801    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:03:47.007686 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:03:47.007642    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3890b076_e81c_4710_95fa_2c8a59d838b4.slice/crio-b5c28f20e0a9bb009f09e90666d08d23b288b3a01be388c94464bfbe7ecaa2a5 WatchSource:0}: Error finding container b5c28f20e0a9bb009f09e90666d08d23b288b3a01be388c94464bfbe7ecaa2a5: Status 404 returned error can't find the container with id b5c28f20e0a9bb009f09e90666d08d23b288b3a01be388c94464bfbe7ecaa2a5
Jul 23 02:03:47.010563 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.010529    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:47.010692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.010601    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:47.010692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.010634    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:47.508272 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.508237    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerStarted","Data":"e7c1356435adb726f9a40339528536b936a82bed9a818c6f12f8e2a8f4898983"}
Jul 23 02:03:47.508526 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.508293    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerStarted","Data":"b5c28f20e0a9bb009f09e90666d08d23b288b3a01be388c94464bfbe7ecaa2a5"}
Jul 23 02:03:47.529358 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.529299    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podStartSLOduration=1.529280873 podStartE2EDuration="1.529280873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:03:47.527840549 +0000 UTC m=+2139.276900235" watchObservedRunningTime="2026-07-23 02:03:47.529280873 +0000 UTC m=+2139.278340545"
Jul 23 02:03:47.848135 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:47.848046    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:48.853133 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:48.853104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:49.453641 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.453591    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:49.517935 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.517906    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:49.518882 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.518866    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:03:49.540060 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.540028    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:03:49.543255 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.543235    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.545665 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.545640    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-99eab2-serving-cert\""
Jul 23 02:03:49.556428 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.556402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:03:49.559795 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.559762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:49.626818 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.626773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.627010 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.626841    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnkcd\" (UniqueName: \"kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.627106 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.627089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.638655 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.638630    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:49.728084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.727994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnkcd\" (UniqueName: \"kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.728084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.728032    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.728304 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.728192    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.728879 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.728854    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.730566 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.730547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.737065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.737039    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnkcd\" (UniqueName: \"kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd\") pod \"maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.764772 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.764734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:49.856169 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.856136    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:49.992222 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:49.992198    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:03:49.994745 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:03:49.994720    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae24ee79_d61d_4789_92f0_993a29231935.slice/crio-96dbf63e11709dab1f76f71e68f045f6e499aa11ea3f69e94b2f9d3f681f17c7 WatchSource:0}: Error finding container 96dbf63e11709dab1f76f71e68f045f6e499aa11ea3f69e94b2f9d3f681f17c7: Status 404 returned error can't find the container with id 96dbf63e11709dab1f76f71e68f045f6e499aa11ea3f69e94b2f9d3f681f17c7
Jul 23 02:03:50.119493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:50.119459    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:50.220774 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:50.220739    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:50.524062 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:50.524013    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" event={"ID":"ae24ee79-d61d-4789-92f0-993a29231935","Type":"ContainerStarted","Data":"96dbf63e11709dab1f76f71e68f045f6e499aa11ea3f69e94b2f9d3f681f17c7"}
Jul 23 02:03:51.529825 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:51.529786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" event={"ID":"ae24ee79-d61d-4789-92f0-993a29231935","Type":"ContainerStarted","Data":"2d0fb8433b492d84869f1b5dae3bc95b8df92ca51a515c58657b597e4f1d57c7"}
Jul 23 02:03:51.530251 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:51.530072    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:51.546263 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:51.546208    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" podStartSLOduration=1.926795717 podStartE2EDuration="2.546192693s" totalImagesPullingTime="619.396976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:03:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:03:51.545051688 +0000 UTC m=+2143.294111361" watchObservedRunningTime="2026-07-23 02:03:51.546192693 +0000 UTC m=+2143.295252365"
Jul 23 02:03:53.925981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:53.925942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:54.254669 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.254584    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:54.533570 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.533419    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:03:54.537260 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.537238    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.539651 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.539607    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-25d739-openshift-default-dockercfg-4m88s\""
Jul 23 02:03:54.546371 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.546339    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:03:54.562668 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.562641    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:54.675452 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675401    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675452 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675455    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675687 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675490    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675687 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675518    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675687 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675687 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675563    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675687 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqwr\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675851 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.675851 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.675775    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777187 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777149    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777281    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777338    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777380 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777368    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777701 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777701 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqwr\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777701 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777676    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777815 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777775    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.777966 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.777949    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.778082 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.778045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.778157 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.778105    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.779797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.779776    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.780047 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.780027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.785349 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.785285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqwr\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.785635 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.785617    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token\") pod \"e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") " pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.851950 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.851910    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:54.998876 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:54.998852    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:03:55.000535 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:03:55.000509    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod669918f0_7818_493b_a339_9b7279fd23d3.slice/crio-1781e34d87d9ccd23f199d14446e9a9c55771e868496b39827d333f8f6190e27 WatchSource:0}: Error finding container 1781e34d87d9ccd23f199d14446e9a9c55771e868496b39827d333f8f6190e27: Status 404 returned error can't find the container with id 1781e34d87d9ccd23f199d14446e9a9c55771e868496b39827d333f8f6190e27
Jul 23 02:03:55.002898 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.002859    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:55.002994 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.002949    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:55.003034 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.002991    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:03:55.559263 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.559217    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerStarted","Data":"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"}
Jul 23 02:03:55.559504 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.559326    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerStarted","Data":"1781e34d87d9ccd23f199d14446e9a9c55771e868496b39827d333f8f6190e27"}
Jul 23 02:03:55.582130 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.582072    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podStartSLOduration=1.5820558070000001 podStartE2EDuration="1.582055807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:03:55.581287268 +0000 UTC m=+2147.330346951" watchObservedRunningTime="2026-07-23 02:03:55.582055807 +0000 UTC m=+2147.331115479"
Jul 23 02:03:55.785748 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.785714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:55.852974 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:55.852878    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:56.857552 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:56.857521    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:57.480665 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.480553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:57.540142 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.540114    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:03:57.562256 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.562217    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:57.569866 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.569833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:57.570940 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.570915    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:03:57.628938 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.628904    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:03:57.633767 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.633741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.636729 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.636700    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-25d739-serving-cert\""
Jul 23 02:03:57.639704 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.639681    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:03:57.801408 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.801313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:57.808429 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.808408    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.808554 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.808465    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvml5\" (UniqueName: \"kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.808554 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.808525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.909265 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.909213    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.909820 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.909319    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.909820 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.909383    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvml5\" (UniqueName: \"kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.909940 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:03:57.909873    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-serving-cert: secret "maas-api-e2e-inf-b-25d739-serving-cert" not found
Jul 23 02:03:57.909940 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:03:57.909938    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls podName:ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e nodeName:}" failed. No retries permitted until 2026-07-23 02:03:58.40991666 +0000 UTC m=+2150.158976316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls") pod "maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" (UID: "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e") : secret "maas-api-e2e-inf-b-25d739-serving-cert" not found
Jul 23 02:03:57.911147 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.911120    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:57.918373 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:57.918347    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvml5\" (UniqueName: \"kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:58.201869 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.201836    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:58.355806 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.355761    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:58.413799 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.413760    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:58.416079 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.416048    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") pod \"maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:58.456494 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.456389    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:03:58.548667 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.548626    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:58.729859 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:58.729831    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:03:58.732345 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:03:58.732306    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6f639f_d27e_42f3_adcb_9eeeb5cfde5e.slice/crio-e57365e6d30b3d9a0bf92ce49a927de06f624216b31c8e403c02d9f9e41d0d03 WatchSource:0}: Error finding container e57365e6d30b3d9a0bf92ce49a927de06f624216b31c8e403c02d9f9e41d0d03: Status 404 returned error can't find the container with id e57365e6d30b3d9a0bf92ce49a927de06f624216b31c8e403c02d9f9e41d0d03
Jul 23 02:03:59.602951 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:59.602907    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" event={"ID":"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e","Type":"ContainerStarted","Data":"c2add589d505337474422c1a323c2b6a2e7b39c117ca2a463be9e6c99d0b2695"}
Jul 23 02:03:59.603498 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:59.602973    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" event={"ID":"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e","Type":"ContainerStarted","Data":"e57365e6d30b3d9a0bf92ce49a927de06f624216b31c8e403c02d9f9e41d0d03"}
Jul 23 02:03:59.603498 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:59.603184    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:03:59.622188 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:03:59.622134    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" podStartSLOduration=2.29009065 podStartE2EDuration="2.622116236s" totalImagesPullingTime="332.025586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:03:59.620648465 +0000 UTC m=+2151.369708129" watchObservedRunningTime="2026-07-23 02:03:59.622116236 +0000 UTC m=+2151.371175907"
Jul 23 02:04:03.231226 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.231194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:03.629568 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.629488    2572 generic.go:356] "Generic (PLEG): container finished" podID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerID="e7c1356435adb726f9a40339528536b936a82bed9a818c6f12f8e2a8f4898983" exitCode=0
Jul 23 02:04:03.629568 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.629558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerDied","Data":"e7c1356435adb726f9a40339528536b936a82bed9a818c6f12f8e2a8f4898983"}
Jul 23 02:04:03.629944 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.629930    2572 scope.go:117] "RemoveContainer" containerID="e7c1356435adb726f9a40339528536b936a82bed9a818c6f12f8e2a8f4898983"
Jul 23 02:04:03.630903 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.630880    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:03.630951 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.630943    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:03.630989 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:03.630974    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:04.518810 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:04.518777    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:04:04.636244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:04.636211    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerStarted","Data":"4a62d732d3981c6c7da40875071f75e96a2b7746d25d52acd4a935dc4e92316f"}
Jul 23 02:04:04.848629 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:04.848544    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:04:04.849888 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:04.849857    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 02:04:04.850020 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:04.849912    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 02:04:05.624170 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:05.624133    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:04:05.848847 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:05.848808    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 02:04:05.849035 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:05.848871    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 02:04:06.849051 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:06.849007    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 02:04:06.849484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:06.849065    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 02:04:07.848895 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:07.848850    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 02:04:07.849109 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:07.848912    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 02:04:08.848699 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:08.848661    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 23 02:04:08.848895 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:08.848717    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 23 02:04:09.853470 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:09.853424    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:04:09.853971 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:09.853837    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:04:09.854661 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:09.854641    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:04:10.002540 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:10.002501    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:10.951815 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:10.951777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:11.052500 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:11.052465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:12.571200 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.571162    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 02:04:12.571614 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.571211    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 02:04:12.678028 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.677991    2572 generic.go:356] "Generic (PLEG): container finished" podID="669918f0-7818-493b-a339-9b7279fd23d3" containerID="17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f" exitCode=0
Jul 23 02:04:12.678194 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.678062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerDied","Data":"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"}
Jul 23 02:04:12.678517 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.678503    2572 scope.go:117] "RemoveContainer" containerID="17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"
Jul 23 02:04:12.679500 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.679477    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:12.679569 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.679539    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:12.679607 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:12.679568    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:04:13.688720 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:13.688679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerStarted","Data":"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"}
Jul 23 02:04:13.852315 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:13.852281    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:04:13.852560 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:13.852537    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 02:04:13.852618 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:13.852590    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 02:04:14.852495 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:14.852427    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 02:04:14.852907 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:14.852513    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 02:04:15.853054 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:15.853021    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 02:04:15.853479 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:15.853074    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 02:04:16.852363 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:16.852325    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 23 02:04:16.852573 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:16.852379    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 23 02:04:17.856739 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:17.856705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:04:17.857221 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:17.857079    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:04:17.857702 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:17.857685    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:04:19.131650 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:19.131619    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:19.230577 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:19.230548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:33.690887 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.690852    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:04:33.694254 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.694231    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.697664 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.697642    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-25d739\"/\"openshift-service-ca.crt\""
Jul 23 02:04:33.698649 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.698634    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-25d739\"/\"test-model-25d739-kserve-self-signed-certs\""
Jul 23 02:04:33.698766 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.698748    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-25d739\"/\"default-dockercfg-ps9bv\""
Jul 23 02:04:33.698824 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.698815    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-25d739\"/\"kube-root-ca.crt\""
Jul 23 02:04:33.712745 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.712719    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:04:33.738387 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.738357    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:04:33.747231 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747209    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.747357 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747243    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.747357 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747269    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.747357 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.747503 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747409    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwqgq\" (UniqueName: \"kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.747503 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.747445    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.848894 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.848860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwqgq\" (UniqueName: \"kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.848992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849068    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849343 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849525 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849712 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849692    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.849759 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.849748    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.851412 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.851390    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.851676 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.851659    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:33.869721 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:33.869693    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwqgq\" (UniqueName: \"kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq\") pod \"test-model-25d739-kserve-64d677c77-76ppz\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") " pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:34.003886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:34.003804    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:34.135080 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:34.135042    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:04:34.137896 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:04:34.137860    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58874dec_d734_4b65_ad52_b91795b2477d.slice/crio-acf6419c8adebc1bcd64c87521e73e2e52b91ba4d869cda737454bf3517678b7 WatchSource:0}: Error finding container acf6419c8adebc1bcd64c87521e73e2e52b91ba4d869cda737454bf3517678b7: Status 404 returned error can't find the container with id acf6419c8adebc1bcd64c87521e73e2e52b91ba4d869cda737454bf3517678b7
Jul 23 02:04:34.794451 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:34.794412    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" event={"ID":"58874dec-d734-4b65-ad52-b91795b2477d","Type":"ContainerStarted","Data":"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"}
Jul 23 02:04:34.794860 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:34.794466    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" event={"ID":"58874dec-d734-4b65-ad52-b91795b2477d","Type":"ContainerStarted","Data":"acf6419c8adebc1bcd64c87521e73e2e52b91ba4d869cda737454bf3517678b7"}
Jul 23 02:04:34.813746 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:34.813700    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" podStartSLOduration=1.8136841970000002 podStartE2EDuration="1.813684197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:04:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:04:34.812363436 +0000 UTC m=+2186.561423107" watchObservedRunningTime="2026-07-23 02:04:34.813684197 +0000 UTC m=+2186.562743869"
Jul 23 02:04:44.004144 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:44.004109    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:44.004662 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:44.004156    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:44.016750 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:44.016721    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:04:44.859010 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:04:44.858983    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:05:16.393555 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:16.393513    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:17.264783 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:17.264750    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:05:20.176839 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:20.176801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:27.871529 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:27.871495    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:05:27.871952 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:27.871686    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" podUID="ae24ee79-d61d-4789-92f0-993a29231935" containerName="maas-api" containerID="cri-o://2d0fb8433b492d84869f1b5dae3bc95b8df92ca51a515c58657b597e4f1d57c7" gracePeriod=30
Jul 23 02:05:27.892677 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:27.892636    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:28.061949 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.061906    2572 generic.go:356] "Generic (PLEG): container finished" podID="ae24ee79-d61d-4789-92f0-993a29231935" containerID="2d0fb8433b492d84869f1b5dae3bc95b8df92ca51a515c58657b597e4f1d57c7" exitCode=0
Jul 23 02:05:28.062090 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.061972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" event={"ID":"ae24ee79-d61d-4789-92f0-993a29231935","Type":"ContainerDied","Data":"2d0fb8433b492d84869f1b5dae3bc95b8df92ca51a515c58657b597e4f1d57c7"}
Jul 23 02:05:28.130847 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.130794    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:05:28.244943 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.244915    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls\") pod \"ae24ee79-d61d-4789-92f0-993a29231935\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") "
Jul 23 02:05:28.245110 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.244961    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca\") pod \"ae24ee79-d61d-4789-92f0-993a29231935\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") "
Jul 23 02:05:28.245110 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.245007    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnkcd\" (UniqueName: \"kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd\") pod \"ae24ee79-d61d-4789-92f0-993a29231935\" (UID: \"ae24ee79-d61d-4789-92f0-993a29231935\") "
Jul 23 02:05:28.245322 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.245299    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ae24ee79-d61d-4789-92f0-993a29231935" (UID: "ae24ee79-d61d-4789-92f0-993a29231935"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:05:28.247005 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.246978    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ae24ee79-d61d-4789-92f0-993a29231935" (UID: "ae24ee79-d61d-4789-92f0-993a29231935"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:05:28.247091 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.247020    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd" (OuterVolumeSpecName: "kube-api-access-jnkcd") pod "ae24ee79-d61d-4789-92f0-993a29231935" (UID: "ae24ee79-d61d-4789-92f0-993a29231935"). InnerVolumeSpecName "kube-api-access-jnkcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:05:28.346001 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.345974    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnkcd\" (UniqueName: \"kubernetes.io/projected/ae24ee79-d61d-4789-92f0-993a29231935-kube-api-access-jnkcd\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:28.346001 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.345999    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae24ee79-d61d-4789-92f0-993a29231935-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:28.346160 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:28.346008    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae24ee79-d61d-4789-92f0-993a29231935-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:29.068709 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:29.068629    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"
Jul 23 02:05:29.068709 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:29.068671    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc" event={"ID":"ae24ee79-d61d-4789-92f0-993a29231935","Type":"ContainerDied","Data":"96dbf63e11709dab1f76f71e68f045f6e499aa11ea3f69e94b2f9d3f681f17c7"}
Jul 23 02:05:29.069170 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:29.068735    2572 scope.go:117] "RemoveContainer" containerID="2d0fb8433b492d84869f1b5dae3bc95b8df92ca51a515c58657b597e4f1d57c7"
Jul 23 02:05:29.089999 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:29.089974    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:05:29.093622 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:29.093599    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-99eab2-7ddfc9868c-svhlc"]
Jul 23 02:05:30.749748 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:30.749710    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae24ee79-d61d-4789-92f0-993a29231935" path="/var/lib/kubelet/pods/ae24ee79-d61d-4789-92f0-993a29231935/volumes"
Jul 23 02:05:32.285136 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.285046    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" podUID="58874dec-d734-4b65-ad52-b91795b2477d" containerName="main" containerID="cri-o://01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1" gracePeriod=45
Jul 23 02:05:32.485302 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.485272    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:32.532480 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.532452    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:05:32.685598 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685566    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.685779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685612    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.685779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685654    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.685779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685689    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.685779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685747    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwqgq\" (UniqueName: \"kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.685779 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685781    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache\") pod \"58874dec-d734-4b65-ad52-b91795b2477d\" (UID: \"58874dec-d734-4b65-ad52-b91795b2477d\") "
Jul 23 02:05:32.686060 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.685838    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:32.686060 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.686011    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home" (OuterVolumeSpecName: "home") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:32.686189 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.686066    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache" (OuterVolumeSpecName: "model-cache") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:32.686189 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.686124    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-tmp-dir\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.686189 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.686137    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-home\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.687926 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.687896    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq" (OuterVolumeSpecName: "kube-api-access-xwqgq") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "kube-api-access-xwqgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:05:32.687926 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.687914    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm" (OuterVolumeSpecName: "dshm") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:32.688041 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.687922    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58874dec-d734-4b65-ad52-b91795b2477d" (UID: "58874dec-d734-4b65-ad52-b91795b2477d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:05:32.787097 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.787070    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58874dec-d734-4b65-ad52-b91795b2477d-tls-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.787097 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.787094    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwqgq\" (UniqueName: \"kubernetes.io/projected/58874dec-d734-4b65-ad52-b91795b2477d-kube-api-access-xwqgq\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.787257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.787104    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-model-cache\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.787257 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.787112    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58874dec-d734-4b65-ad52-b91795b2477d-dshm\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:32.883801 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:32.883774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:33.089241 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.089152    2572 generic.go:356] "Generic (PLEG): container finished" podID="58874dec-d734-4b65-ad52-b91795b2477d" containerID="01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1" exitCode=0
Jul 23 02:05:33.089241 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.089202    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"
Jul 23 02:05:33.089491 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.089237    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" event={"ID":"58874dec-d734-4b65-ad52-b91795b2477d","Type":"ContainerDied","Data":"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"}
Jul 23 02:05:33.089491 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.089279    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz" event={"ID":"58874dec-d734-4b65-ad52-b91795b2477d","Type":"ContainerDied","Data":"acf6419c8adebc1bcd64c87521e73e2e52b91ba4d869cda737454bf3517678b7"}
Jul 23 02:05:33.089491 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.089296    2572 scope.go:117] "RemoveContainer" containerID="01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"
Jul 23 02:05:33.098104 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.098088    2572 scope.go:117] "RemoveContainer" containerID="01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"
Jul 23 02:05:33.098362 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:05:33.098342    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1\": container with ID starting with 01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1 not found: ID does not exist" containerID="01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"
Jul 23 02:05:33.098481 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.098376    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1"} err="failed to get container status \"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1\": rpc error: code = NotFound desc = could not find container \"01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1\": container with ID starting with 01439add63d0d9b2ec84756295183a6bcc76b7d45c0ed657a6722edb890c53f1 not found: ID does not exist"
Jul 23 02:05:33.105592 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.105569    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:05:33.107352 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:33.107326    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-25d739/test-model-25d739-kserve-64d677c77-76ppz"]
Jul 23 02:05:34.749880 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:34.749850    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58874dec-d734-4b65-ad52-b91795b2477d" path="/var/lib/kubelet/pods/58874dec-d734-4b65-ad52-b91795b2477d/volumes"
Jul 23 02:05:38.776082 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:38.776045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:38.845000 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:38.844973    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:39.011279 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.011246    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:05:39.011533 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.011507    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" containerID="cri-o://4a62d732d3981c6c7da40875071f75e96a2b7746d25d52acd4a935dc4e92316f" gracePeriod=30
Jul 23 02:05:39.038910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.038850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:39.258849 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.258816    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:39.856226 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.856187    2572 patch_prober.go:28] interesting pod/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 02:05:39.856647 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.856248    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 02:05:39.908969 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:39.908936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:40.811886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:40.811857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:44.156919 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.156889    2572 generic.go:356] "Generic (PLEG): container finished" podID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerID="4a62d732d3981c6c7da40875071f75e96a2b7746d25d52acd4a935dc4e92316f" exitCode=0
Jul 23 02:05:44.157344 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.156967    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerDied","Data":"4a62d732d3981c6c7da40875071f75e96a2b7746d25d52acd4a935dc4e92316f"}
Jul 23 02:05:44.157344 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.157044    2572 scope.go:117] "RemoveContainer" containerID="e7c1356435adb726f9a40339528536b936a82bed9a818c6f12f8e2a8f4898983"
Jul 23 02:05:44.266494 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.266469    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:05:44.392105 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392032    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392105 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392063    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392105 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392115    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392157    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392177    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392198    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392235    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392305    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kq9k\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k\") pod \"3890b076-e81c-4710-95fa-2c8a59d838b4\" (UID: \"3890b076-e81c-4710-95fa-2c8a59d838b4\") "
Jul 23 02:05:44.392370 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392331    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:44.392918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392508    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:44.392918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392697    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.392918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392717    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.392918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392764    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:05:44.392918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.392796    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:44.393180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.393076    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:44.394385 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.394350    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:05:44.394520 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.394464    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:05:44.394520 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.394489    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k" (OuterVolumeSpecName: "kube-api-access-2kq9k") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "kube-api-access-2kq9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:05:44.394608 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.394541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3890b076-e81c-4710-95fa-2c8a59d838b4" (UID: "3890b076-e81c-4710-95fa-2c8a59d838b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:05:44.493541 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493511    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3890b076-e81c-4710-95fa-2c8a59d838b4-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493541 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493535    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kq9k\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-kube-api-access-2kq9k\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493541 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493545    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493762 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493553    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493762 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493561    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493762 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493568    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3890b076-e81c-4710-95fa-2c8a59d838b4-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:44.493762 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:44.493575    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3890b076-e81c-4710-95fa-2c8a59d838b4-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:45.162521 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:45.162499    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"
Jul 23 02:05:45.162918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:45.162518    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7" event={"ID":"3890b076-e81c-4710-95fa-2c8a59d838b4","Type":"ContainerDied","Data":"b5c28f20e0a9bb009f09e90666d08d23b288b3a01be388c94464bfbe7ecaa2a5"}
Jul 23 02:05:45.162918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:45.162573    2572 scope.go:117] "RemoveContainer" containerID="4a62d732d3981c6c7da40875071f75e96a2b7746d25d52acd4a935dc4e92316f"
Jul 23 02:05:45.184701 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:45.184673    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:05:45.188042 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:45.188010    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-99eab2-openshift-default-59884c777c-6c8n7"]
Jul 23 02:05:46.749816 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:46.749779    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" path="/var/lib/kubelet/pods/3890b076-e81c-4710-95fa-2c8a59d838b4/volumes"
Jul 23 02:05:49.843524 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:49.843493    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:05:49.844083 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:49.843733    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" podUID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" containerName="maas-api" containerID="cri-o://c2add589d505337474422c1a323c2b6a2e7b39c117ca2a463be9e6c99d0b2695" gracePeriod=30
Jul 23 02:05:49.876429 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:49.876404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:50.189219 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.189190    2572 generic.go:356] "Generic (PLEG): container finished" podID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" containerID="c2add589d505337474422c1a323c2b6a2e7b39c117ca2a463be9e6c99d0b2695" exitCode=0
Jul 23 02:05:50.189360 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.189275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" event={"ID":"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e","Type":"ContainerDied","Data":"c2add589d505337474422c1a323c2b6a2e7b39c117ca2a463be9e6c99d0b2695"}
Jul 23 02:05:50.288914 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.288893    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:05:50.346040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.345998    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca\") pod \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") "
Jul 23 02:05:50.346203 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.346048    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvml5\" (UniqueName: \"kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5\") pod \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") "
Jul 23 02:05:50.346203 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.346074    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") pod \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\" (UID: \"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e\") "
Jul 23 02:05:50.346412 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.346389    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" (UID: "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:05:50.348101 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.348079    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5" (OuterVolumeSpecName: "kube-api-access-jvml5") pod "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" (UID: "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e"). InnerVolumeSpecName "kube-api-access-jvml5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:05:50.348209 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.348189    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" (UID: "ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:05:50.391592 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.391533    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:50.447558 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.447534    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:50.447558 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.447555    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvml5\" (UniqueName: \"kubernetes.io/projected/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-kube-api-access-jvml5\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:50.447681 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:50.447570    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:05:51.195116 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:51.195088    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"
Jul 23 02:05:51.195557 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:51.195125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk" event={"ID":"ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e","Type":"ContainerDied","Data":"e57365e6d30b3d9a0bf92ce49a927de06f624216b31c8e403c02d9f9e41d0d03"}
Jul 23 02:05:51.195557 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:51.195191    2572 scope.go:117] "RemoveContainer" containerID="c2add589d505337474422c1a323c2b6a2e7b39c117ca2a463be9e6c99d0b2695"
Jul 23 02:05:51.211644 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:51.211621    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:05:51.215900 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:51.215879    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-25d739-6cf79ff64-qhzhk"]
Jul 23 02:05:52.748738 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:52.748706    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" path="/var/lib/kubelet/pods/ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e/volumes"
Jul 23 02:05:54.448618 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:54.448586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:05:54.841498 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:05:54.841399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:00.601134 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:00.601105    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:00.666202 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:00.666175    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:00.843453 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:00.843400    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:06:00.843689 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:00.843654    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" containerID="cri-o://22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f" gracePeriod=30
Jul 23 02:06:00.860483 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:00.860399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:01.107497 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.107465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:01.412981 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.412948    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:01.695959 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.695883    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:06:01.696475 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696450    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58874dec-d734-4b65-ad52-b91795b2477d" containerName="main"
Jul 23 02:06:01.696475 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696474    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="58874dec-d734-4b65-ad52-b91795b2477d" containerName="main"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696497    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae24ee79-d61d-4789-92f0-993a29231935" containerName="maas-api"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696506    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae24ee79-d61d-4789-92f0-993a29231935" containerName="maas-api"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696523    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" containerName="maas-api"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696532    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" containerName="maas-api"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696547    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:01.696639 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696555    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:01.696828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696660    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:01.696828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696672    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="58874dec-d734-4b65-ad52-b91795b2477d" containerName="main"
Jul 23 02:06:01.696828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696687    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:01.696828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696696    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae24ee79-d61d-4789-92f0-993a29231935" containerName="maas-api"
Jul 23 02:06:01.696828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.696705    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6f639f-d27e-42f3-adcb-9eeeb5cfde5e" containerName="maas-api"
Jul 23 02:06:01.701482 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.701461    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.703696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.703679    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-dec09f-openshift-default-dockercfg-f42bd\""
Jul 23 02:06:01.711259 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.711237    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:06:01.729147 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.729121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:01.743331 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743305    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743446 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743358    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743446 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hxz\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743446 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743400    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743619 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743619 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743610    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743767 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743745    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743831 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.743892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.743851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845048    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845258 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845091    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hxz\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845258 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845258 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845207    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845422 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845336    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845422 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845394    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845551 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845423    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845602 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845559    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845660 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.845854 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845824    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.846005 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.846005 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845937    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.846176 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.845948    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.846176 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.846107    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.847711 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.847684    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.847914 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.847899    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.852816 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.852793    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.853019 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.852996    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hxz\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz\") pod \"e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") " pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:01.989858 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:01.989781    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:02.014420 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.014401    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:02.153742 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.153716    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:06:02.156145 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:06:02.156116    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2e5eed_872e_424b_b341_aedc78d4bff8.slice/crio-b79d09e29d59827a93c357f169f5862e9fde8b29256627197524d24f26d772f9 WatchSource:0}: Error finding container b79d09e29d59827a93c357f169f5862e9fde8b29256627197524d24f26d772f9: Status 404 returned error can't find the container with id b79d09e29d59827a93c357f169f5862e9fde8b29256627197524d24f26d772f9
Jul 23 02:06:02.158204 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.158174    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:02.158272 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.158239    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:02.158272 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.158268    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:02.249359 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.249270    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerStarted","Data":"0bd865e833ca127b1366e8a25d7003a8c62d303afc0746439fc5f361796063ef"}
Jul 23 02:06:02.249359 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.249350    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerStarted","Data":"b79d09e29d59827a93c357f169f5862e9fde8b29256627197524d24f26d772f9"}
Jul 23 02:06:02.270281 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.270223    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podStartSLOduration=1.270203065 podStartE2EDuration="1.270203065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:06:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:06:02.267214718 +0000 UTC m=+2274.016274394" watchObservedRunningTime="2026-07-23 02:06:02.270203065 +0000 UTC m=+2274.019262738"
Jul 23 02:06:02.859381 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.859338    2572 patch_prober.go:28] interesting pod/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 02:06:02.859836 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:02.859402    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 02:06:03.015339 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:03.015308    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:03.020304 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:03.020279    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:03.254297 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:03.254269    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:03.255251 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:03.255231    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:04.161139 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.161107    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:04.278263 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.278229    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:04.309230 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.309202    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:04.309598 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.309585    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:04.309650 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.309600    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3890b076-e81c-4710-95fa-2c8a59d838b4" containerName="istio-proxy"
Jul 23 02:06:04.312734 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.312694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.315523 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.315501    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-dec09f-serving-cert\""
Jul 23 02:06:04.341240 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.341212    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:04.367471 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.367446    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.367582 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.367488    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.367582 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.367510    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8jnb\" (UniqueName: \"kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.458121 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.458043    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:04.468301 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.468282    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.468397 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.468310    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8jnb\" (UniqueName: \"kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.468397 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.468390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.468923 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.468896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.470766 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.470746    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.482953 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.482930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8jnb\" (UniqueName: \"kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb\") pod \"maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.559642 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.559614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:04.623859 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.623834    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:04.757358 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.757330    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:04.759351 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:06:04.759316    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0901bc0a_ce91_4be5_8829_cfaefa6e8b78.slice/crio-e9b1153f30b403e59453cc905eb34655dc8962f674eee2c678beb3b11e1023eb WatchSource:0}: Error finding container e9b1153f30b403e59453cc905eb34655dc8962f674eee2c678beb3b11e1023eb: Status 404 returned error can't find the container with id e9b1153f30b403e59453cc905eb34655dc8962f674eee2c678beb3b11e1023eb
Jul 23 02:06:04.872450 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.872411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:04.971959 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:04.971915    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:05.267169 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:05.267137    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" event={"ID":"0901bc0a-ce91-4be5-8829-cfaefa6e8b78","Type":"ContainerStarted","Data":"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"}
Jul 23 02:06:05.267556 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:05.267230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" event={"ID":"0901bc0a-ce91-4be5-8829-cfaefa6e8b78","Type":"ContainerStarted","Data":"e9b1153f30b403e59453cc905eb34655dc8962f674eee2c678beb3b11e1023eb"}
Jul 23 02:06:05.285250 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:05.285200    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" podStartSLOduration=0.874512475 podStartE2EDuration="1.285180914s" totalImagesPullingTime="410.668439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:06:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:06:05.284082631 +0000 UTC m=+2277.033142328" watchObservedRunningTime="2026-07-23 02:06:05.285180914 +0000 UTC m=+2277.034240590"
Jul 23 02:06:06.088920 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.088898    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:06:06.182993 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.182968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183138 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183005    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zqwr\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183138 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183028    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183138 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183064    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183138 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183090    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183138 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183124    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183416 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183160    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183416 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183207    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183416 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy\") pod \"669918f0-7818-493b-a339-9b7279fd23d3\" (UID: \"669918f0-7818-493b-a339-9b7279fd23d3\") "
Jul 23 02:06:06.183416 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183321    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:06:06.183654 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183484    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:06:06.183654 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183504    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:06:06.183752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183685    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:06:06.183752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183708    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.183752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183732    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/669918f0-7818-493b-a339-9b7279fd23d3-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.183752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.183747    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.184024 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.184000    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data" (OuterVolumeSpecName: "istio-data") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:06:06.185392 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.185373    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token" (OuterVolumeSpecName: "istio-token") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:06:06.185469 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.185420    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:06:06.185644 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.185619    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:06:06.185745 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.185715    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr" (OuterVolumeSpecName: "kube-api-access-5zqwr") pod "669918f0-7818-493b-a339-9b7279fd23d3" (UID: "669918f0-7818-493b-a339-9b7279fd23d3"). InnerVolumeSpecName "kube-api-access-5zqwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:06:06.274268 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274237    2572 generic.go:356] "Generic (PLEG): container finished" podID="669918f0-7818-493b-a339-9b7279fd23d3" containerID="22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f" exitCode=0
Jul 23 02:06:06.274731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274286    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"
Jul 23 02:06:06.274731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerDied","Data":"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"}
Jul 23 02:06:06.274731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk" event={"ID":"669918f0-7818-493b-a339-9b7279fd23d3","Type":"ContainerDied","Data":"1781e34d87d9ccd23f199d14446e9a9c55771e868496b39827d333f8f6190e27"}
Jul 23 02:06:06.274731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274427    2572 scope.go:117] "RemoveContainer" containerID="22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"
Jul 23 02:06:06.274731 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.274626    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:06.283537 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.283516    2572 scope.go:117] "RemoveContainer" containerID="17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"
Jul 23 02:06:06.284151 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284125    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zqwr\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-kube-api-access-5zqwr\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.284236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284157    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/669918f0-7818-493b-a339-9b7279fd23d3-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.284236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284172    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.284236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284183    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/669918f0-7818-493b-a339-9b7279fd23d3-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.284236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284194    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.284236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.284206    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/669918f0-7818-493b-a339-9b7279fd23d3-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:06.291302 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.291288    2572 scope.go:117] "RemoveContainer" containerID="22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"
Jul 23 02:06:06.291571 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:06:06.291550    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f\": container with ID starting with 22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f not found: ID does not exist" containerID="22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"
Jul 23 02:06:06.291667 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.291581    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f"} err="failed to get container status \"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f\": rpc error: code = NotFound desc = could not find container \"22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f\": container with ID starting with 22c735b78d67c640d48d277a302a2640d25a090698175c84731e03958cfc9f8f not found: ID does not exist"
Jul 23 02:06:06.291667 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.291604    2572 scope.go:117] "RemoveContainer" containerID="17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"
Jul 23 02:06:06.291856 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:06:06.291840    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f\": container with ID starting with 17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f not found: ID does not exist" containerID="17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"
Jul 23 02:06:06.291895 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.291862    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f"} err="failed to get container status \"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f\": rpc error: code = NotFound desc = could not find container \"17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f\": container with ID starting with 17ac6732d1c4687713111823da326dcb528c672167f0a507ad0bfea0aff6299f not found: ID does not exist"
Jul 23 02:06:06.299948 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.299919    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:06:06.305043 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.305023    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-25d739-openshift-default-798f88fbb7-2wsmk"]
Jul 23 02:06:06.748961 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:06.748932    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="669918f0-7818-493b-a339-9b7279fd23d3" path="/var/lib/kubelet/pods/669918f0-7818-493b-a339-9b7279fd23d3/volumes"
Jul 23 02:06:08.654027 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:08.653981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:09.119255 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.119225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:09.391802 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.391726    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:06:09.392106 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392093    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.392149 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392107    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.392149 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392126    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.392149 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392131    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.392236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392185    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.392236 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.392195    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="669918f0-7818-493b-a339-9b7279fd23d3" containerName="istio-proxy"
Jul 23 02:06:09.396923 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.396905    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.399643 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.399623    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cf5ce0-openshift-default-dockercfg-fhxnc\""
Jul 23 02:06:09.409167 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.409141    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:06:09.436121 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.436093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:09.512516 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512560    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512581    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512692 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512620    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512906 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512710    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512906 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.512906 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.512838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvtt6\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613273 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613243    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613417 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvtt6\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613417 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613309    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613543 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613420    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613543 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613477    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613543 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613511    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613543 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613534    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613751 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613751 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613638    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613885 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613867    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.613998 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.613972    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.614077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.614027    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.614077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.614047    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.614183 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.614087    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.615643 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.615624    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.615987 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.615966    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.620938 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.620917    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.621141 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.621120    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvtt6\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6\") pod \"e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") " pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.707268 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.707237    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:09.707894 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.707870    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:09.849977 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.849953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:06:09.852775 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:06:09.852748    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c43564_b15f_45d4_8998_6428d7117556.slice/crio-e8e23d8074699e82ddabf18e6f075a3f0dba97ee44ff08a7447c327528c38657 WatchSource:0}: Error finding container e8e23d8074699e82ddabf18e6f075a3f0dba97ee44ff08a7447c327528c38657: Status 404 returned error can't find the container with id e8e23d8074699e82ddabf18e6f075a3f0dba97ee44ff08a7447c327528c38657
Jul 23 02:06:09.855059 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.855022    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:09.855163 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.855104    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:09.855163 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:09.855148    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:10.298076 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:10.298041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerStarted","Data":"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"}
Jul 23 02:06:10.298227 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:10.298102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerStarted","Data":"e8e23d8074699e82ddabf18e6f075a3f0dba97ee44ff08a7447c327528c38657"}
Jul 23 02:06:10.317334 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:10.317281    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podStartSLOduration=1.317261505 podStartE2EDuration="1.317261505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:06:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:06:10.315543173 +0000 UTC m=+2282.064602845" watchObservedRunningTime="2026-07-23 02:06:10.317261505 +0000 UTC m=+2282.066321178"
Jul 23 02:06:10.707661 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:10.707629    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:10.712531 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:10.712500    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:11.303040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:11.303015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:11.304065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:11.304045    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:12.286206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:12.286181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:12.359123 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:12.359093    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:12.478067 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:12.478039    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:12.640126 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:12.640049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:13.016600 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:13.016562    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:13.113630 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:13.113588    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:16.724364 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:16.724330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:19.200349 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:19.200315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:19.297604 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:19.297564    2572 patch_prober.go:28] interesting pod/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 02:06:19.297789 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:19.297615    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 02:06:20.347632 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.347546    2572 generic.go:356] "Generic (PLEG): container finished" podID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerID="0bd865e833ca127b1366e8a25d7003a8c62d303afc0746439fc5f361796063ef" exitCode=0
Jul 23 02:06:20.347632 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.347615    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerDied","Data":"0bd865e833ca127b1366e8a25d7003a8c62d303afc0746439fc5f361796063ef"}
Jul 23 02:06:20.348083 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.348041    2572 scope.go:117] "RemoveContainer" containerID="0bd865e833ca127b1366e8a25d7003a8c62d303afc0746439fc5f361796063ef"
Jul 23 02:06:20.349210 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.349183    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:20.349310 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.349257    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:20.349310 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:20.349288    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:21.354620 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:21.354584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerStarted","Data":"af2e152ee5d8742f16b16485003f6c9975c02bcf11b40373dc92a7a4692a4c6a"}
Jul 23 02:06:22.014953 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:22.014911    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:22.015429 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:22.015395    2572 patch_prober.go:28] interesting pod/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 02:06:22.015589 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:22.015474    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 02:06:23.015250 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:23.015201    2572 patch_prober.go:28] interesting pod/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 02:06:23.015813 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:23.015289    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 02:06:24.015640 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:24.015598    2572 patch_prober.go:28] interesting pod/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 02:06:24.016219 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:24.016185    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 02:06:25.015879 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:25.015838    2572 patch_prober.go:28] interesting pod/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Jul 23 02:06:25.016538 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:25.016500    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Jul 23 02:06:25.788937 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:25.788844    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:25.889431 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:25.889392    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:26.020212 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:26.020181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:26.020684 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:26.020560    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:26.021315 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:26.021291    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:06:27.345573 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:27.345529    2572 patch_prober.go:28] interesting pod/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 23 02:06:27.345960 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:27.345581    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 23 02:06:28.396514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.396482    2572 generic.go:356] "Generic (PLEG): container finished" podID="b3c43564-b15f-45d4-8998-6428d7117556" containerID="19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262" exitCode=0
Jul 23 02:06:28.396980 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.396554    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerDied","Data":"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"}
Jul 23 02:06:28.397070 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.397053    2572 scope.go:117] "RemoveContainer" containerID="19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"
Jul 23 02:06:28.398016 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.397989    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:28.398118 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.398066    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:28.398248 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:28.398127    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:06:29.403918 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:29.403887    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerStarted","Data":"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"}
Jul 23 02:06:29.708310 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:29.708267    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:29.708586 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:29.708559    2572 patch_prober.go:28] interesting pod/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 23 02:06:29.708673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:29.708617    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 23 02:06:30.707878 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:30.707839    2572 patch_prober.go:28] interesting pod/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 23 02:06:30.708313 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:30.707898    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 23 02:06:31.707939 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:31.707906    2572 patch_prober.go:28] interesting pod/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 23 02:06:31.708335 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:31.707961    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 23 02:06:32.707950 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:32.707915    2572 patch_prober.go:28] interesting pod/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 23 02:06:32.708343 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:32.707984    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 23 02:06:33.711339 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:33.711309    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:33.711775 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:33.711654    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:33.712350 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:33.712333    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:06:33.938677 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:33.938644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:34.039666 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:34.039591    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:40.319532 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:40.319503    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:40.419775 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:40.419740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:45.555534 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.555501    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:45.556200 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.555758    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" podUID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" containerName="maas-api" containerID="cri-o://c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b" gracePeriod=30
Jul 23 02:06:45.811081 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.811020    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:45.946973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.946943    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca\") pod \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") "
Jul 23 02:06:45.947148 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.947012    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8jnb\" (UniqueName: \"kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb\") pod \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") "
Jul 23 02:06:45.947148 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.947044    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls\") pod \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\" (UID: \"0901bc0a-ce91-4be5-8829-cfaefa6e8b78\") "
Jul 23 02:06:45.947298 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.947274    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0901bc0a-ce91-4be5-8829-cfaefa6e8b78" (UID: "0901bc0a-ce91-4be5-8829-cfaefa6e8b78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:06:45.949101 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.949081    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0901bc0a-ce91-4be5-8829-cfaefa6e8b78" (UID: "0901bc0a-ce91-4be5-8829-cfaefa6e8b78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:06:45.949214 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:45.949125    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb" (OuterVolumeSpecName: "kube-api-access-k8jnb") pod "0901bc0a-ce91-4be5-8829-cfaefa6e8b78" (UID: "0901bc0a-ce91-4be5-8829-cfaefa6e8b78"). InnerVolumeSpecName "kube-api-access-k8jnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:06:46.047655 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.047630    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-openshift-service-ca\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:46.047655 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.047653    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8jnb\" (UniqueName: \"kubernetes.io/projected/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-kube-api-access-k8jnb\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:46.047807 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.047663    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0901bc0a-ce91-4be5-8829-cfaefa6e8b78-maas-api-tls\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:06:46.416192 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.416157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:46.493479 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.493419    2572 generic.go:356] "Generic (PLEG): container finished" podID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" containerID="c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b" exitCode=0
Jul 23 02:06:46.493479 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.493469    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" event={"ID":"0901bc0a-ce91-4be5-8829-cfaefa6e8b78","Type":"ContainerDied","Data":"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"}
Jul 23 02:06:46.493696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.493490    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"
Jul 23 02:06:46.493696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.493532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9" event={"ID":"0901bc0a-ce91-4be5-8829-cfaefa6e8b78","Type":"ContainerDied","Data":"e9b1153f30b403e59453cc905eb34655dc8962f674eee2c678beb3b11e1023eb"}
Jul 23 02:06:46.493696 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.493558    2572 scope.go:117] "RemoveContainer" containerID="c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"
Jul 23 02:06:46.502515 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.502501    2572 scope.go:117] "RemoveContainer" containerID="c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"
Jul 23 02:06:46.502756 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:06:46.502724    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b\": container with ID starting with c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b not found: ID does not exist" containerID="c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"
Jul 23 02:06:46.502818 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.502762    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b"} err="failed to get container status \"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b\": rpc error: code = NotFound desc = could not find container \"c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b\": container with ID starting with c465a61e2eb6ae121a66853f10c98f1b653e3767706b69f21c868bfd2e63a03b not found: ID does not exist"
Jul 23 02:06:46.514462 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.514428    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:46.517340 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.517321    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dec09f-7f6d54df57-chkl9"]
Jul 23 02:06:46.749214 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:46.749144    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" path="/var/lib/kubelet/pods/0901bc0a-ce91-4be5-8829-cfaefa6e8b78/volumes"
Jul 23 02:06:49.854082 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:49.854050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:50.223413 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:50.223378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:56.093641 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.093607    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:56.197958 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.197929    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:56.344690 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.344605    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:06:56.344862 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.344811    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy" containerID="cri-o://af2e152ee5d8742f16b16485003f6c9975c02bcf11b40373dc92a7a4692a4c6a" gracePeriod=30
Jul 23 02:06:56.366552 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.366525    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:56.585568 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:56.585535    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:57.309885 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:57.309851    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:06:57.411548 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:06:57.411512    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:01.568904 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.568854    2572 generic.go:356] "Generic (PLEG): container finished" podID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerID="af2e152ee5d8742f16b16485003f6c9975c02bcf11b40373dc92a7a4692a4c6a" exitCode=0
Jul 23 02:07:01.569298 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.568986    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerDied","Data":"af2e152ee5d8742f16b16485003f6c9975c02bcf11b40373dc92a7a4692a4c6a"}
Jul 23 02:07:01.569298 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.569063    2572 scope.go:117] "RemoveContainer" containerID="0bd865e833ca127b1366e8a25d7003a8c62d303afc0746439fc5f361796063ef"
Jul 23 02:07:01.615743 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.615689    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:07:01.684614 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.684797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684627    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.684797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684654    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.684797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684685    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5hxz\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.684797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684706    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.684797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684730    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.685072 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685001    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:07:01.685072 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685011    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:01.685072 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.684994    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:01.685196 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685106    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.685196 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685145    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.685196 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685174    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token\") pod \"8d2e5eed-872e-424b-b341-aedc78d4bff8\" (UID: \"8d2e5eed-872e-424b-b341-aedc78d4bff8\") "
Jul 23 02:07:01.685407 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685388    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:01.685567 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685542    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d2e5eed-872e-424b-b341-aedc78d4bff8-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.685632 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685564    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.685632 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685579    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.685632 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.685594    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.686212 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.686185    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:01.687287 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.687251    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:07:01.687287 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.687260    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:01.687476 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.687302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz" (OuterVolumeSpecName: "kube-api-access-m5hxz") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "kube-api-access-m5hxz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:07:01.687476 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.687330    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d2e5eed-872e-424b-b341-aedc78d4bff8" (UID: "8d2e5eed-872e-424b-b341-aedc78d4bff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:07:01.786849 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.786823    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.786849 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.786845    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5hxz\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-kube-api-access-m5hxz\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.786997 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.786856    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.786997 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.786865    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:01.786997 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:01.786873    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d2e5eed-872e-424b-b341-aedc78d4bff8-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:02.574865 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.574836    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"
Jul 23 02:07:02.574865 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.574855    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t" event={"ID":"8d2e5eed-872e-424b-b341-aedc78d4bff8","Type":"ContainerDied","Data":"b79d09e29d59827a93c357f169f5862e9fde8b29256627197524d24f26d772f9"}
Jul 23 02:07:02.575412 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.574917    2572 scope.go:117] "RemoveContainer" containerID="af2e152ee5d8742f16b16485003f6c9975c02bcf11b40373dc92a7a4692a4c6a"
Jul 23 02:07:02.595920 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.595896    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:07:02.598620 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.598600    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-dec09f-openshift-default-c96c585d5-2fz5t"]
Jul 23 02:07:02.748708 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:02.748684    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" path="/var/lib/kubelet/pods/8d2e5eed-872e-424b-b341-aedc78d4bff8/volumes"
Jul 23 02:07:12.203310 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:12.203256    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:16.790077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:16.790049    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:17.169508 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:17.169473    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:22.940263 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:22.940232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:23.042672 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.042644    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:23.174046 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.174008    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:07:23.174281 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.174229    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy" containerID="cri-o://3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5" gracePeriod=30
Jul 23 02:07:23.193772 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.193701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:23.414859 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.414821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:23.774160 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:23.774117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:24.069109 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069035    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069383    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" containerName="maas-api"
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069394    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" containerName="maas-api"
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069406    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069412    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069421    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.069486 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069426    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.069689 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069502    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0901bc0a-ce91-4be5-8829-cfaefa6e8b78" containerName="maas-api"
Jul 23 02:07:24.069689 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069512    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.069689 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.069518    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2e5eed-872e-424b-b341-aedc78d4bff8" containerName="istio-proxy"
Jul 23 02:07:24.071958 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.071940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.074485 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.074462    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-1dd296-openshift-default-dockercfg-rxsbm\""
Jul 23 02:07:24.086215 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.086192    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:07:24.094855 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.094831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:24.165600 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165565    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.165782 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.165782 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.165886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.165886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165828    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.165886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165879    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.166046 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165927    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kd4q\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.166046 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.165979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.166046 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.166018    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266623 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266653    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266680    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266713    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kd4q\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.266828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.266823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267154 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267154 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267084    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267154 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267098    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267303 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267193    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267303 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267274    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267379 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267369    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.267546 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.267524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.268902 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.268882    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.269514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.269493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.274861 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.274843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kd4q\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.274861 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.274852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token\") pod \"e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") " pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.340406 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.340314    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:24.381645 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.381613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:24.517694 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.517665    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:07:24.521058 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:07:24.521030    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7d8149_4cc8_4050_915f_7372d624cd01.slice/crio-3439c5e79faed1692e15ded0bd68c9fb6b002cba27ab745832e4719b0b98d5a0 WatchSource:0}: Error finding container 3439c5e79faed1692e15ded0bd68c9fb6b002cba27ab745832e4719b0b98d5a0: Status 404 returned error can't find the container with id 3439c5e79faed1692e15ded0bd68c9fb6b002cba27ab745832e4719b0b98d5a0
Jul 23 02:07:24.523488 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.523460    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:24.523566 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.523522    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:24.523566 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.523552    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:24.685206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.685165    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerStarted","Data":"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"}
Jul 23 02:07:24.685406 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.685265    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerStarted","Data":"3439c5e79faed1692e15ded0bd68c9fb6b002cba27ab745832e4719b0b98d5a0"}
Jul 23 02:07:24.705519 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:24.705476    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podStartSLOduration=0.705462038 podStartE2EDuration="705.462038ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:07:24.703742426 +0000 UTC m=+2356.452802099" watchObservedRunningTime="2026-07-23 02:07:24.705462038 +0000 UTC m=+2356.454521710"
Jul 23 02:07:25.382369 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:25.382330    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:25.387122 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:25.387099    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:25.690146 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:25.690113    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:25.691064 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:25.691047    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:26.609024 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:26.608986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:26.696873 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:26.696835    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:26.859631 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:26.859537    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:27.032863 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:27.032820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:27.320360 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:27.320320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:27.420733 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:27.420703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:28.426348 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.426324    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:07:28.504229 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504160    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504229 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504196    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504229 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504225    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504285    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504335    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504354    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504376    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvtt6\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504405    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504430    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs\") pod \"b3c43564-b15f-45d4-8998-6428d7117556\" (UID: \"b3c43564-b15f-45d4-8998-6428d7117556\") "
Jul 23 02:07:28.504828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504426    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:28.504828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504650    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:28.504828 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504818    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:28.505002 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.504759    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:07:28.505181 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.505143    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:28.506375 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.506350    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:07:28.506513 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.506457    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:07:28.506680 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.506659    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6" (OuterVolumeSpecName: "kube-api-access-lvtt6") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "kube-api-access-lvtt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:07:28.506729 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.506697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3c43564-b15f-45d4-8998-6428d7117556" (UID: "b3c43564-b15f-45d4-8998-6428d7117556"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:07:28.606183 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606156    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606183 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606182    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606191    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c43564-b15f-45d4-8998-6428d7117556-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606199    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606207    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606215    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c43564-b15f-45d4-8998-6428d7117556-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606223    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvtt6\" (UniqueName: \"kubernetes.io/projected/b3c43564-b15f-45d4-8998-6428d7117556-kube-api-access-lvtt6\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606232    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.606378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.606240    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c43564-b15f-45d4-8998-6428d7117556-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:07:28.705678 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.705645    2572 generic.go:356] "Generic (PLEG): container finished" podID="b3c43564-b15f-45d4-8998-6428d7117556" containerID="3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5" exitCode=0
Jul 23 02:07:28.705811 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.705691    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"
Jul 23 02:07:28.705811 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.705729    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerDied","Data":"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"}
Jul 23 02:07:28.705811 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.705783    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt" event={"ID":"b3c43564-b15f-45d4-8998-6428d7117556","Type":"ContainerDied","Data":"e8e23d8074699e82ddabf18e6f075a3f0dba97ee44ff08a7447c327528c38657"}
Jul 23 02:07:28.705811 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.705805    2572 scope.go:117] "RemoveContainer" containerID="3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"
Jul 23 02:07:28.714896 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.714881    2572 scope.go:117] "RemoveContainer" containerID="19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"
Jul 23 02:07:28.723074 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.723055    2572 scope.go:117] "RemoveContainer" containerID="3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"
Jul 23 02:07:28.723343 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:07:28.723325    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5\": container with ID starting with 3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5 not found: ID does not exist" containerID="3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"
Jul 23 02:07:28.723393 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.723358    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5"} err="failed to get container status \"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5\": rpc error: code = NotFound desc = could not find container \"3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5\": container with ID starting with 3c2e9870557f5f4d0d5ef33a514b2b3d2fa39e1b992df96861e4de784ed796e5 not found: ID does not exist"
Jul 23 02:07:28.723393 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.723378    2572 scope.go:117] "RemoveContainer" containerID="19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"
Jul 23 02:07:28.723650 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:07:28.723632    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262\": container with ID starting with 19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262 not found: ID does not exist" containerID="19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"
Jul 23 02:07:28.723703 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.723655    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262"} err="failed to get container status \"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262\": rpc error: code = NotFound desc = could not find container \"19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262\": container with ID starting with 19bdf99bbbf2fcc1f99a3cf583cffb6fa7de55bad890d0aeef8d86670fb3b262 not found: ID does not exist"
Jul 23 02:07:28.730723 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.730703    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:07:28.736477 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.736457    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cf5ce0-openshift-default-845c65c97-jv9bt"]
Jul 23 02:07:28.748077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:28.748058    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c43564-b15f-45d4-8998-6428d7117556" path="/var/lib/kubelet/pods/b3c43564-b15f-45d4-8998-6428d7117556/volumes"
Jul 23 02:07:31.168124 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.168078    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:31.494524 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.494421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:31.786338 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786264    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:07:31.786670 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786656    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:07:31.786730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786673    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:07:31.786730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786686    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:07:31.786730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786692    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:07:31.786824 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.786758    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:07:31.789850 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.789832    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.793220 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.793200    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5fbcb9-openshift-default-dockercfg-rmss5\""
Jul 23 02:07:31.805642 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.805619    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:07:31.831573 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.831551    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:31.934259 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934461 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934272    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934461 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934346    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934461 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934381    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934461 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934426    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934646 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934472    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934646 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934498    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934646 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:31.934646 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:31.934531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsh57\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035553 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035553 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035557    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035747 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035578    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035747 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035688    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035747 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035731    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsh57\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035853 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035787    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035853 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035833    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035956 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035880    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.035956 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035938    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.036056 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035955    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.036056 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.035995    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.036056 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.036034    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.036278 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.036254    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.036645 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.036587    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.037993 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.037975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.038322 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.038305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.043115 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.043033    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.043303 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.043288    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsh57\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57\") pod \"e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") " pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.101514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.101468    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:32.246611 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.246585    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:07:32.248861 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:07:32.248833    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce9cce4_a131_445e_8211_ff200c2b8d9c.slice/crio-828699c3dd5e83ff2562fd859c17bdca64cfa794b75e52de81e6aeaf1903d4af WatchSource:0}: Error finding container 828699c3dd5e83ff2562fd859c17bdca64cfa794b75e52de81e6aeaf1903d4af: Status 404 returned error can't find the container with id 828699c3dd5e83ff2562fd859c17bdca64cfa794b75e52de81e6aeaf1903d4af
Jul 23 02:07:32.251050 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.251012    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:32.251123 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.251085    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:32.251123 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.251115    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:32.257092 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.257070    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:32.727265 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.727219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerStarted","Data":"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"}
Jul 23 02:07:32.727469 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.727284    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerStarted","Data":"828699c3dd5e83ff2562fd859c17bdca64cfa794b75e52de81e6aeaf1903d4af"}
Jul 23 02:07:32.751926 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:32.751880    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podStartSLOduration=1.751864359 podStartE2EDuration="1.751864359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:07:32.750096777 +0000 UTC m=+2364.499156449" watchObservedRunningTime="2026-07-23 02:07:32.751864359 +0000 UTC m=+2364.500924030"
Jul 23 02:07:33.102294 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:33.102190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:33.107277 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:33.107251    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:33.732025 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:33.731995    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:33.733019 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:33.732997    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:34.671861 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:34.671818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:34.766484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:34.766430    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:34.898786 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:34.898749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:35.007682 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:35.007596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:35.351972 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:35.351884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:35.452497 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:35.452454    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:39.164766 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.164735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:39.761758 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.761688    2572 generic.go:356] "Generic (PLEG): container finished" podID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerID="b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80" exitCode=0
Jul 23 02:07:39.761934 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.761760    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerDied","Data":"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"}
Jul 23 02:07:39.762131 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.762118    2572 scope.go:117] "RemoveContainer" containerID="b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"
Jul 23 02:07:39.763207 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.763180    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:39.763281 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.763263    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:39.763327 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:39.763314    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:40.690872 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:40.690829    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:40.768087 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:40.768052    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerStarted","Data":"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"}
Jul 23 02:07:41.383088 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:41.383051    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:41.383547 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:41.383524    2572 patch_prober.go:28] interesting pod/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 23 02:07:41.383727 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:41.383702    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 23 02:07:42.382921 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:42.382880    2572 patch_prober.go:28] interesting pod/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 23 02:07:42.383575 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:42.383531    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 23 02:07:43.382406 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:43.382357    2572 patch_prober.go:28] interesting pod/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 23 02:07:43.382641 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:43.382450    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 23 02:07:44.382268 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:44.382229    2572 patch_prober.go:28] interesting pod/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Jul 23 02:07:44.382900 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:44.382867    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Jul 23 02:07:45.387077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:45.387045    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:45.387488 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:45.387285    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:45.388149 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:45.388130    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:07:47.814045 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.814014    2572 generic.go:356] "Generic (PLEG): container finished" podID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerID="42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5" exitCode=0
Jul 23 02:07:47.814475 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.814085    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerDied","Data":"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"}
Jul 23 02:07:47.814527 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.814478    2572 scope.go:117] "RemoveContainer" containerID="42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"
Jul 23 02:07:47.815463 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.815420    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:47.815525 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.815510    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:47.815569 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:47.815551    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 23 02:07:48.732118 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:48.732086    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:48.820901 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:48.820866    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerStarted","Data":"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"}
Jul 23 02:07:48.933706 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:48.933670    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:49.039378 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:49.039286    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:49.102606 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:49.102573    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:49.103650 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:49.103620    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 02:07:49.103784 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:49.103672    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 02:07:50.101941 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:50.101901    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 02:07:50.102362 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:50.101960    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 02:07:50.612971 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:50.612922    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:51.102661 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:51.102619    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 02:07:51.103086 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:51.102692    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 02:07:52.102059 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:52.102020    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 02:07:52.102268 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:52.102085    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 02:07:53.102281 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:53.102242    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Jul 23 02:07:53.102757 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:53.102322    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Jul 23 02:07:54.106045 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:54.106015    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:54.106520 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:54.106363    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:54.107149 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:54.107128    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:07:56.136921 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:56.136869    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:07:56.241840 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:07:56.241808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:08:08.882084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:08.882056    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:08:08.889242 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:08.889220    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:08:09.454594 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.454561    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:08:09.894789 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.894711    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:08:09.895165 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.895143    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c43564-b15f-45d4-8998-6428d7117556" containerName="istio-proxy"
Jul 23 02:08:09.897903 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.897886    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.901067 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.901043    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"openshift-service-ca.crt\""
Jul 23 02:08:09.901221 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.901067    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"default-dockercfg-x66bf\""
Jul 23 02:08:09.901221 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.901086    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"auth-test-model-5fbcb9-kserve-self-signed-certs\""
Jul 23 02:08:09.901221 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.901070    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"kube-root-ca.crt\""
Jul 23 02:08:09.905407 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.905389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:08:09.975559 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.975520    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:08:09.977740 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977722    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.977849 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977750    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.977920 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977846    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.977920 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977883    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpsdn\" (UniqueName: \"kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.978023 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977924    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:09.978023 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:09.977993    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.078862 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.078828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.078930    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.078959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpsdn\" (UniqueName: \"kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.078994    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079065 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.079061    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079259 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.079103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079460 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.079409    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079575 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.079430    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.079575 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.079540    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.081083 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.081066    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.081456 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.081426    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.086869 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.086851    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpsdn\" (UniqueName: \"kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn\") pod \"auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") " pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.208538 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.208499    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:10.349417 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.349386    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:08:10.352687 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:08:10.352661    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7cefa9c_1145_4ffd_aa0e_48b012000745.slice/crio-039fe1d2c340f0a6aef6b5c77ae0e55f9615c0a51df900af315d7e325e1c8b07 WatchSource:0}: Error finding container 039fe1d2c340f0a6aef6b5c77ae0e55f9615c0a51df900af315d7e325e1c8b07: Status 404 returned error can't find the container with id 039fe1d2c340f0a6aef6b5c77ae0e55f9615c0a51df900af315d7e325e1c8b07
Jul 23 02:08:10.933531 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.933495    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" event={"ID":"a7cefa9c-1145-4ffd-aa0e-48b012000745","Type":"ContainerStarted","Data":"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"}
Jul 23 02:08:10.934034 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.933547    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" event={"ID":"a7cefa9c-1145-4ffd-aa0e-48b012000745","Type":"ContainerStarted","Data":"039fe1d2c340f0a6aef6b5c77ae0e55f9615c0a51df900af315d7e325e1c8b07"}
Jul 23 02:08:10.949386 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:10.949339    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" podStartSLOduration=1.949326889 podStartE2EDuration="1.949326889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:08:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:08:10.947729969 +0000 UTC m=+2402.696789642" watchObservedRunningTime="2026-07-23 02:08:10.949326889 +0000 UTC m=+2402.698386560"
Jul 23 02:08:20.209563 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:20.209526    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:20.210051 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:20.209604    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:20.222002 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:20.221977    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:20.995521 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:20.995493    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:08:34.966693 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:34.966612    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:08:35.068599 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:08:35.068565    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:10:01.941662 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:01.941575    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:10:19.222252 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:19.222216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:10:20.172613 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:20.172577    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:10:20.193313 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:20.193282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:10:22.713675 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:22.713639    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:10:35.193472 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.193399    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" podUID="a7cefa9c-1145-4ffd-aa0e-48b012000745" containerName="main" containerID="cri-o://8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768" gracePeriod=45
Jul 23 02:10:35.435316 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.435292    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:10:35.556198 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556098    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556198 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556162    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556222    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpsdn\" (UniqueName: \"kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556275    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556300    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556353    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home\") pod \"a7cefa9c-1145-4ffd-aa0e-48b012000745\" (UID: \"a7cefa9c-1145-4ffd-aa0e-48b012000745\") "
Jul 23 02:10:35.556484 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556366    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache" (OuterVolumeSpecName: "model-cache") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:10:35.556752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556506    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:10:35.556752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556660    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home" (OuterVolumeSpecName: "home") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:10:35.556752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556728    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-tmp-dir\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.556752 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.556748    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-model-cache\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.558654 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.558633    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn" (OuterVolumeSpecName: "kube-api-access-tpsdn") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "kube-api-access-tpsdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:10:35.558654 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.558638    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:10:35.558756 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.558638    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm" (OuterVolumeSpecName: "dshm") pod "a7cefa9c-1145-4ffd-aa0e-48b012000745" (UID: "a7cefa9c-1145-4ffd-aa0e-48b012000745"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:10:35.649208 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.649174    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7cefa9c-1145-4ffd-aa0e-48b012000745" containerID="8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768" exitCode=0
Jul 23 02:10:35.649376 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.649217    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"
Jul 23 02:10:35.649376 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.649247    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" event={"ID":"a7cefa9c-1145-4ffd-aa0e-48b012000745","Type":"ContainerDied","Data":"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"}
Jul 23 02:10:35.649376 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.649277    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf" event={"ID":"a7cefa9c-1145-4ffd-aa0e-48b012000745","Type":"ContainerDied","Data":"039fe1d2c340f0a6aef6b5c77ae0e55f9615c0a51df900af315d7e325e1c8b07"}
Jul 23 02:10:35.649376 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.649294    2572 scope.go:117] "RemoveContainer" containerID="8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"
Jul 23 02:10:35.657347 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.657320    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpsdn\" (UniqueName: \"kubernetes.io/projected/a7cefa9c-1145-4ffd-aa0e-48b012000745-kube-api-access-tpsdn\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.657493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.657351    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cefa9c-1145-4ffd-aa0e-48b012000745-tls-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.657493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.657366    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-dshm\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.657493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.657378    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cefa9c-1145-4ffd-aa0e-48b012000745-home\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:10:35.658680 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.658665    2572 scope.go:117] "RemoveContainer" containerID="8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"
Jul 23 02:10:35.658937 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:10:35.658913    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768\": container with ID starting with 8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768 not found: ID does not exist" containerID="8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"
Jul 23 02:10:35.658996 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.658946    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768"} err="failed to get container status \"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768\": rpc error: code = NotFound desc = could not find container \"8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768\": container with ID starting with 8c81ea1f4e44e41d7de5180711608cf12beb95e8b93abf8f96d17994d31b7768 not found: ID does not exist"
Jul 23 02:10:35.670491 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.670462    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:10:35.674784 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:35.674763    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/auth-test-model-5fbcb9-kserve-85f4cb5f8c-556mf"]
Jul 23 02:10:36.749684 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:36.749643    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7cefa9c-1145-4ffd-aa0e-48b012000745" path="/var/lib/kubelet/pods/a7cefa9c-1145-4ffd-aa0e-48b012000745/volumes"
Jul 23 02:10:50.756802 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:10:50.756763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:23.646164 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:23.646134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:24.711199 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:24.711169    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:35.475514 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:35.475391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:35.575748 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:35.575716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:48.162497 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:48.162464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:48.218335 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:48.218305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:11:59.221247 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:11:59.221211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:12:22.688995 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.688959    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:12:22.689558 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.689544    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7cefa9c-1145-4ffd-aa0e-48b012000745" containerName="main"
Jul 23 02:12:22.689637 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.689562    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7cefa9c-1145-4ffd-aa0e-48b012000745" containerName="main"
Jul 23 02:12:22.689637 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.689635    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7cefa9c-1145-4ffd-aa0e-48b012000745" containerName="main"
Jul 23 02:12:22.692594 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.692578    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.695395 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.695370    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"openshift-service-ca.crt\""
Jul 23 02:12:22.695395 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.695377    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"kube-root-ca.crt\""
Jul 23 02:12:22.695576 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.695425    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"default-dockercfg-x66bf\""
Jul 23 02:12:22.695927 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.695912    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-5fbcb9\"/\"rate-test-model-5fbcb9-kserve-self-signed-certs\""
Jul 23 02:12:22.701247 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.701226    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:12:22.707736 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.707711    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:12:22.738110 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.738314 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738123    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.738314 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738190    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.738314 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738220    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txd4w\" (UniqueName: \"kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.738314 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.738314 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.738288    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839502 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839715 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839715 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839666    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txd4w\" (UniqueName: \"kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839715 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839709    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839892 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.839946 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839895    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.840004 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.839941    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.840133 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.840106    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.840203 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.840186    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.841995 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.841973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.842152 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.842130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:22.847013 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:22.846986    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txd4w\" (UniqueName: \"kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w\") pod \"rate-test-model-5fbcb9-kserve-68c5f57847-gp745\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") " pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:23.003084 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:23.002993    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:23.140175 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:23.140138    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:12:23.142493 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:12:23.142464    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d6fe632_385b_47db_a246_ab6dea2a9afd.slice/crio-8c77eb341e2b35950d300e65e700afd543bc3249d81991d42f2b281d855f40b2 WatchSource:0}: Error finding container 8c77eb341e2b35950d300e65e700afd543bc3249d81991d42f2b281d855f40b2: Status 404 returned error can't find the container with id 8c77eb341e2b35950d300e65e700afd543bc3249d81991d42f2b281d855f40b2
Jul 23 02:12:23.174826 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:23.174802    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" event={"ID":"5d6fe632-385b-47db-a246-ab6dea2a9afd","Type":"ContainerStarted","Data":"8c77eb341e2b35950d300e65e700afd543bc3249d81991d42f2b281d855f40b2"}
Jul 23 02:12:24.181012 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:24.180980    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" event={"ID":"5d6fe632-385b-47db-a246-ab6dea2a9afd","Type":"ContainerStarted","Data":"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"}
Jul 23 02:12:24.196912 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:24.196864    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" podStartSLOduration=2.196850498 podStartE2EDuration="2.196850498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:12:24.195980411 +0000 UTC m=+2655.945040084" watchObservedRunningTime="2026-07-23 02:12:24.196850498 +0000 UTC m=+2655.945910167"
Jul 23 02:12:33.004127 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:33.004087    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:33.004616 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:33.004182    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:33.017140 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:33.017116    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:33.241311 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:33.241275    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:12:49.712057 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:49.712025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:12:49.810651 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:49.810620    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:12:57.040695 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:57.040658    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:12:57.140214 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:12:57.140176    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:04.754768 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:04.754685    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:05.596112 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:05.596081    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:13:05.617798 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:05.617768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:08.910299 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:08.910268    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:13:08.917853 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:08.917828    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:13:09.785564 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.785530    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140487957150640"]
Jul 23 02:13:09.789007 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.788984    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:09.791315 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.791293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cqlmt\""
Jul 23 02:13:09.792741 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.792719    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957150640"]
Jul 23 02:13:09.893576 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.893534    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkt5m\" (UniqueName: \"kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m\") pod \"test-curl-7724-140487957150640\" (UID: \"e8a18112-026b-46ac-a5d4-ec385d27c936\") " pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:09.995146 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:09.995108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkt5m\" (UniqueName: \"kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m\") pod \"test-curl-7724-140487957150640\" (UID: \"e8a18112-026b-46ac-a5d4-ec385d27c936\") " pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:10.003195 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:10.003174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkt5m\" (UniqueName: \"kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m\") pod \"test-curl-7724-140487957150640\" (UID: \"e8a18112-026b-46ac-a5d4-ec385d27c936\") " pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:10.099601 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:10.099532    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:10.230548 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:10.230523    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957150640"]
Jul 23 02:13:10.232546 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:13:10.232516    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8a18112_026b_46ac_a5d4_ec385d27c936.slice/crio-8a34698d9dd91dbdba2d4a0a4190526fcc699613f64e2b3b69d85fd5d59d9bb6 WatchSource:0}: Error finding container 8a34698d9dd91dbdba2d4a0a4190526fcc699613f64e2b3b69d85fd5d59d9bb6: Status 404 returned error can't find the container with id 8a34698d9dd91dbdba2d4a0a4190526fcc699613f64e2b3b69d85fd5d59d9bb6
Jul 23 02:13:10.234174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:10.234153    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 02:13:10.416288 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:10.416252    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957150640" event={"ID":"e8a18112-026b-46ac-a5d4-ec385d27c936","Type":"ContainerStarted","Data":"8a34698d9dd91dbdba2d4a0a4190526fcc699613f64e2b3b69d85fd5d59d9bb6"}
Jul 23 02:13:11.422223 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:11.422183    2572 generic.go:356] "Generic (PLEG): container finished" podID="e8a18112-026b-46ac-a5d4-ec385d27c936" containerID="3d9670ff92f658de06638b07cd1d48c2b47b889cbe4c535c16c222724d0c50be" exitCode=0
Jul 23 02:13:11.422674 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:11.422268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957150640" event={"ID":"e8a18112-026b-46ac-a5d4-ec385d27c936","Type":"ContainerDied","Data":"3d9670ff92f658de06638b07cd1d48c2b47b889cbe4c535c16c222724d0c50be"}
Jul 23 02:13:12.565680 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.565658    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:12.585547 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.585521    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140487957150640_e8a18112-026b-46ac-a5d4-ec385d27c936/test-curl-7724-140487957150640/0.log"
Jul 23 02:13:12.605952 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.605913    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140487957150640"]
Jul 23 02:13:12.609992 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.609961    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140487957150640"]
Jul 23 02:13:12.720786 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.720705    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkt5m\" (UniqueName: \"kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m\") pod \"e8a18112-026b-46ac-a5d4-ec385d27c936\" (UID: \"e8a18112-026b-46ac-a5d4-ec385d27c936\") "
Jul 23 02:13:12.722813 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.722785    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m" (OuterVolumeSpecName: "kube-api-access-dkt5m") pod "e8a18112-026b-46ac-a5d4-ec385d27c936" (UID: "e8a18112-026b-46ac-a5d4-ec385d27c936"). InnerVolumeSpecName "kube-api-access-dkt5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:12.750699 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.750666    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8a18112-026b-46ac-a5d4-ec385d27c936" path="/var/lib/kubelet/pods/e8a18112-026b-46ac-a5d4-ec385d27c936/volumes"
Jul 23 02:13:12.801014 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.800983    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:12.801337 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.801326    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8a18112-026b-46ac-a5d4-ec385d27c936" containerName="test-curl-7724-140487957150640"
Jul 23 02:13:12.801389 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.801339    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8a18112-026b-46ac-a5d4-ec385d27c936" containerName="test-curl-7724-140487957150640"
Jul 23 02:13:12.801389 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.801388    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8a18112-026b-46ac-a5d4-ec385d27c936" containerName="test-curl-7724-140487957150640"
Jul 23 02:13:12.804588 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.804572    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:12.808497 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.808473    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:12.822077 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.822029    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkt5m\" (UniqueName: \"kubernetes.io/projected/e8a18112-026b-46ac-a5d4-ec385d27c936-kube-api-access-dkt5m\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:12.922563 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:12.922529    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9npp\" (UniqueName: \"kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp\") pod \"test-curl-7724-140487957267776\" (UID: \"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:13.023637 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.023558    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9npp\" (UniqueName: \"kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp\") pod \"test-curl-7724-140487957267776\" (UID: \"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:13.031010 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.030983    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9npp\" (UniqueName: \"kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp\") pod \"test-curl-7724-140487957267776\" (UID: \"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:13.114479 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.114427    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:13.247576 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.247530    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:13.249650 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:13:13.249625    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81a4ea43_b1e6_4fc9_96e6_95d2fe440d82.slice/crio-2589801f48a0834aa82addb57e8d3b0380fe219a5ebaee7d754534f924b5dec9 WatchSource:0}: Error finding container 2589801f48a0834aa82addb57e8d3b0380fe219a5ebaee7d754534f924b5dec9: Status 404 returned error can't find the container with id 2589801f48a0834aa82addb57e8d3b0380fe219a5ebaee7d754534f924b5dec9
Jul 23 02:13:13.433423 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.433388    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957267776" event={"ID":"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82","Type":"ContainerStarted","Data":"2589801f48a0834aa82addb57e8d3b0380fe219a5ebaee7d754534f924b5dec9"}
Jul 23 02:13:13.434596 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.434577    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957150640"
Jul 23 02:13:13.434723 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:13.434603    2572 scope.go:117] "RemoveContainer" containerID="3d9670ff92f658de06638b07cd1d48c2b47b889cbe4c535c16c222724d0c50be"
Jul 23 02:13:14.442509 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:14.442471    2572 generic.go:356] "Generic (PLEG): container finished" podID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" containerID="fa23b6043a4a3d46443d960dd08778920d67a4f379b9b90d8adfcc23f28b01f3" exitCode=0
Jul 23 02:13:14.442903 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:14.442532    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957267776" event={"ID":"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82","Type":"ContainerDied","Data":"fa23b6043a4a3d46443d960dd08778920d67a4f379b9b90d8adfcc23f28b01f3"}
Jul 23 02:13:15.586760 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.586734    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:15.605685 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.605658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140487957267776_81a4ea43-b1e6-4fc9-96e6-95d2fe440d82/test-curl-7724-140487957267776/0.log"
Jul 23 02:13:15.629725 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.629692    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:15.632742 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.632723    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:15.650109 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.650082    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9npp\" (UniqueName: \"kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp\") pod \"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82\" (UID: \"81a4ea43-b1e6-4fc9-96e6-95d2fe440d82\") "
Jul 23 02:13:15.652092 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.652061    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp" (OuterVolumeSpecName: "kube-api-access-w9npp") pod "81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" (UID: "81a4ea43-b1e6-4fc9-96e6-95d2fe440d82"). InnerVolumeSpecName "kube-api-access-w9npp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:15.751647 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.751573    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9npp\" (UniqueName: \"kubernetes.io/projected/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82-kube-api-access-w9npp\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:15.761711 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.761684    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:15.762039 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.762027    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" containerName="test-curl-7724-140487957267776"
Jul 23 02:13:15.762100 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.762041    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" containerName="test-curl-7724-140487957267776"
Jul 23 02:13:15.762137 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.762102    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" containerName="test-curl-7724-140487957267776"
Jul 23 02:13:15.765338 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.765323    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:15.770950 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.770923    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:15.852840 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.852807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264hq\" (UniqueName: \"kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq\") pod \"test-curl-7724-140487957267776\" (UID: \"18dd9fe1-bfc8-462e-b749-f86a870afcdc\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:15.953453 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.953409    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264hq\" (UniqueName: \"kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq\") pod \"test-curl-7724-140487957267776\" (UID: \"18dd9fe1-bfc8-462e-b749-f86a870afcdc\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:15.961545 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:15.961525    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264hq\" (UniqueName: \"kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq\") pod \"test-curl-7724-140487957267776\" (UID: \"18dd9fe1-bfc8-462e-b749-f86a870afcdc\") " pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:16.076141 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.076051    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:16.204922 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.204897    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:16.206731 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:13:16.206706    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18dd9fe1_bfc8_462e_b749_f86a870afcdc.slice/crio-0f1564af8c23e6d1277c1528850d14bbbd926b9c2cb6582636e6986a09183408 WatchSource:0}: Error finding container 0f1564af8c23e6d1277c1528850d14bbbd926b9c2cb6582636e6986a09183408: Status 404 returned error can't find the container with id 0f1564af8c23e6d1277c1528850d14bbbd926b9c2cb6582636e6986a09183408
Jul 23 02:13:16.453470 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.453425    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:16.453470 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.453469    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2589801f48a0834aa82addb57e8d3b0380fe219a5ebaee7d754534f924b5dec9"
Jul 23 02:13:16.454678 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.454653    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957267776" event={"ID":"18dd9fe1-bfc8-462e-b749-f86a870afcdc","Type":"ContainerStarted","Data":"0f1564af8c23e6d1277c1528850d14bbbd926b9c2cb6582636e6986a09183408"}
Jul 23 02:13:16.464610 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.464575    2572 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7724-140487957267776" oldPodUID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" podUID="18dd9fe1-bfc8-462e-b749-f86a870afcdc"
Jul 23 02:13:16.749513 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:16.749413    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81a4ea43-b1e6-4fc9-96e6-95d2fe440d82" path="/var/lib/kubelet/pods/81a4ea43-b1e6-4fc9-96e6-95d2fe440d82/volumes"
Jul 23 02:13:17.461035 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:17.461000    2572 generic.go:356] "Generic (PLEG): container finished" podID="18dd9fe1-bfc8-462e-b749-f86a870afcdc" containerID="281ea7facdde2c761f140efaec759e3bda71f2a81c9607d540eab3f07add2322" exitCode=0
Jul 23 02:13:17.461218 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:17.461080    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7724-140487957267776" event={"ID":"18dd9fe1-bfc8-462e-b749-f86a870afcdc","Type":"ContainerDied","Data":"281ea7facdde2c761f140efaec759e3bda71f2a81c9607d540eab3f07add2322"}
Jul 23 02:13:18.605596 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.605571    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:18.625675 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.625650    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7724-140487957267776_18dd9fe1-bfc8-462e-b749-f86a870afcdc/test-curl-7724-140487957267776/0.log"
Jul 23 02:13:18.646626 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.646594    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:18.650410 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.650386    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7724-140487957267776"]
Jul 23 02:13:18.679979 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.679958    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-264hq\" (UniqueName: \"kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq\") pod \"18dd9fe1-bfc8-462e-b749-f86a870afcdc\" (UID: \"18dd9fe1-bfc8-462e-b749-f86a870afcdc\") "
Jul 23 02:13:18.681925 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.681899    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq" (OuterVolumeSpecName: "kube-api-access-264hq") pod "18dd9fe1-bfc8-462e-b749-f86a870afcdc" (UID: "18dd9fe1-bfc8-462e-b749-f86a870afcdc"). InnerVolumeSpecName "kube-api-access-264hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:18.754001 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.753917    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18dd9fe1-bfc8-462e-b749-f86a870afcdc" path="/var/lib/kubelet/pods/18dd9fe1-bfc8-462e-b749-f86a870afcdc/volumes"
Jul 23 02:13:18.781389 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:18.781367    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-264hq\" (UniqueName: \"kubernetes.io/projected/18dd9fe1-bfc8-462e-b749-f86a870afcdc-kube-api-access-264hq\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:19.472294 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:19.472267    2572 scope.go:117] "RemoveContainer" containerID="281ea7facdde2c761f140efaec759e3bda71f2a81c9607d540eab3f07add2322"
Jul 23 02:13:19.472503 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:19.472267    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7724-140487957267776"
Jul 23 02:13:20.616448 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:20.616396    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" podUID="5d6fe632-385b-47db-a246-ab6dea2a9afd" containerName="main" containerID="cri-o://aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6" gracePeriod=45
Jul 23 02:13:20.875838 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:20.875781    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:13:21.003487 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003452    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003487 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003487    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003514    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txd4w\" (UniqueName: \"kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003578    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003616    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003650    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm\") pod \"5d6fe632-385b-47db-a246-ab6dea2a9afd\" (UID: \"5d6fe632-385b-47db-a246-ab6dea2a9afd\") "
Jul 23 02:13:21.003730 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003688    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:21.003955 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003755    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:21.003955 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003856    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home" (OuterVolumeSpecName: "home") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:21.004070 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003968    2572 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-home\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.004070 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003983    2572 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-model-cache\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.004070 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.003993    2572 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-tmp-dir\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.005683 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.005661    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm" (OuterVolumeSpecName: "dshm") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:21.005791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.005697    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 02:13:21.005791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.005709    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w" (OuterVolumeSpecName: "kube-api-access-txd4w") pod "5d6fe632-385b-47db-a246-ab6dea2a9afd" (UID: "5d6fe632-385b-47db-a246-ab6dea2a9afd"). InnerVolumeSpecName "kube-api-access-txd4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:21.104373 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.104349    2572 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5d6fe632-385b-47db-a246-ab6dea2a9afd-tls-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.104373 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.104371    2572 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5d6fe632-385b-47db-a246-ab6dea2a9afd-dshm\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.104538 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.104381    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txd4w\" (UniqueName: \"kubernetes.io/projected/5d6fe632-385b-47db-a246-ab6dea2a9afd-kube-api-access-txd4w\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:21.483456 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.483400    2572 generic.go:356] "Generic (PLEG): container finished" podID="5d6fe632-385b-47db-a246-ab6dea2a9afd" containerID="aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6" exitCode=0
Jul 23 02:13:21.483605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.483468    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"
Jul 23 02:13:21.483605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.483489    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" event={"ID":"5d6fe632-385b-47db-a246-ab6dea2a9afd","Type":"ContainerDied","Data":"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"}
Jul 23 02:13:21.483605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.483537    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745" event={"ID":"5d6fe632-385b-47db-a246-ab6dea2a9afd","Type":"ContainerDied","Data":"8c77eb341e2b35950d300e65e700afd543bc3249d81991d42f2b281d855f40b2"}
Jul 23 02:13:21.483605 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.483554    2572 scope.go:117] "RemoveContainer" containerID="aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"
Jul 23 02:13:21.492270 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.492255    2572 scope.go:117] "RemoveContainer" containerID="aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"
Jul 23 02:13:21.492543 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:13:21.492525    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6\": container with ID starting with aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6 not found: ID does not exist" containerID="aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"
Jul 23 02:13:21.492582 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.492550    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6"} err="failed to get container status \"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6\": rpc error: code = NotFound desc = could not find container \"aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6\": container with ID starting with aaecec59a5df207bc1c0f9288bbb8a2209615d8aa6717b6d6c96e6cec35750a6 not found: ID does not exist"
Jul 23 02:13:21.504555 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.504532    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:13:21.507707 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:21.507688    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-5fbcb9/rate-test-model-5fbcb9-kserve-68c5f57847-gp745"]
Jul 23 02:13:22.748900 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:22.748870    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6fe632-385b-47db-a246-ab6dea2a9afd" path="/var/lib/kubelet/pods/5d6fe632-385b-47db-a246-ab6dea2a9afd/volumes"
Jul 23 02:13:25.559039 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:25.559006    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:25.659320 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:25.659291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:35.938066 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:35.937993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:36.038362 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:36.038324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:36.226067 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:36.225986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:40.004082 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:40.004050    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:40.454029 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:40.453995    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:46.479086 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:46.479025    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:46.540355 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:46.540323    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:46.733620 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:46.733542    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:13:46.733826 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:46.733804    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy" containerID="cri-o://b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64" gracePeriod=30
Jul 23 02:13:46.760148 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:46.760121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:47.006764 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:47.006671    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:47.662576 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:47.662544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:47.769799 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:47.769768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:13:51.986659 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:51.986638    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:13:52.079044 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.078968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079044 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079011    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079052    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079096    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079175    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079244 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079220    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079481 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079250    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kd4q\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079481 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079276    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079481 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079303    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket\") pod \"5f7d8149-4cc8-4050-915f-7372d624cd01\" (UID: \"5f7d8149-4cc8-4050-915f-7372d624cd01\") "
Jul 23 02:13:52.079662 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079521    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:52.079733 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079712    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.079798 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079733    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:52.079798 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.079746    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:52.080029 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.080006    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:13:52.080115 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.080054    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data" (OuterVolumeSpecName: "istio-data") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:52.081388 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.081362    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:13:52.081581 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.081557    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q" (OuterVolumeSpecName: "kube-api-access-6kd4q") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "kube-api-access-6kd4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:52.081682 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.081663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token" (OuterVolumeSpecName: "istio-token") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:13:52.081725 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.081667    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5f7d8149-4cc8-4050-915f-7372d624cd01" (UID: "5f7d8149-4cc8-4050-915f-7372d624cd01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:13:52.180562 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180539    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5f7d8149-4cc8-4050-915f-7372d624cd01-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180564    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180576    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180590    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180602    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180612    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180624    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5f7d8149-4cc8-4050-915f-7372d624cd01-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.180673 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.180636    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kd4q\" (UniqueName: \"kubernetes.io/projected/5f7d8149-4cc8-4050-915f-7372d624cd01-kube-api-access-6kd4q\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:13:52.635417 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.635382    2572 generic.go:356] "Generic (PLEG): container finished" podID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerID="b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64" exitCode=0
Jul 23 02:13:52.635630 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.635451    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"
Jul 23 02:13:52.635630 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.635486    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerDied","Data":"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"}
Jul 23 02:13:52.635630 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.635540    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq" event={"ID":"5f7d8149-4cc8-4050-915f-7372d624cd01","Type":"ContainerDied","Data":"3439c5e79faed1692e15ded0bd68c9fb6b002cba27ab745832e4719b0b98d5a0"}
Jul 23 02:13:52.635630 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.635563    2572 scope.go:117] "RemoveContainer" containerID="b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"
Jul 23 02:13:52.645734 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.645720    2572 scope.go:117] "RemoveContainer" containerID="b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"
Jul 23 02:13:52.653021 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.653005    2572 scope.go:117] "RemoveContainer" containerID="b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"
Jul 23 02:13:52.653267 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:13:52.653246    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64\": container with ID starting with b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64 not found: ID does not exist" containerID="b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"
Jul 23 02:13:52.653320 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.653276    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64"} err="failed to get container status \"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64\": rpc error: code = NotFound desc = could not find container \"b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64\": container with ID starting with b6ac989743925a4ff281843e7c394c54aeb133da1f52b346c5849b965f3c4c64 not found: ID does not exist"
Jul 23 02:13:52.653320 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.653293    2572 scope.go:117] "RemoveContainer" containerID="b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"
Jul 23 02:13:52.653537 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:13:52.653517    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80\": container with ID starting with b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80 not found: ID does not exist" containerID="b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"
Jul 23 02:13:52.653591 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.653543    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80"} err="failed to get container status \"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80\": rpc error: code = NotFound desc = could not find container \"b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80\": container with ID starting with b454b8bf072968e5b58a1ae1fcdeb2e82da9d89b544e475fd77e3b4500917f80 not found: ID does not exist"
Jul 23 02:13:52.657423 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.657401    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:13:52.662330 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.662309    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-1dd296-openshift-default-bd6b54f5f-jfwxq"]
Jul 23 02:13:52.748343 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:52.748320    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" path="/var/lib/kubelet/pods/5f7d8149-4cc8-4050-915f-7372d624cd01/volumes"
Jul 23 02:13:57.831642 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:13:57.831601    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:01.281993 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:01.281959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:01.383743 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:01.383705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:02.227626 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:02.227590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:02.654549 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:02.654461    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:08.600744 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:08.600684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:08.703343 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:08.703305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:08.880421 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:08.880339    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:14:08.880609 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:08.880582    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" containerID="cri-o://9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb" gracePeriod=30
Jul 23 02:14:08.908036 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:08.907977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:09.109069 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:09.109040    2572 patch_prober.go:28] interesting pod/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 02:14:09.109206 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:09.109103    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 02:14:09.142175 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:09.142086    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:09.614976 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:09.614938    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf8cf7d96-t9x7t_4de5b36c-029b-4ed8-9572-e84a9582e39d/authorino/0.log"
Jul 23 02:14:14.140717 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.140695    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:14:14.290869 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.290818    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291045 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.290906    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291045 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291014    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291153 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291051    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291153 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291122    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsh57\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291240 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291150    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291240 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291190    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291480    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291482    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291552    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket\") pod \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\" (UID: \"8ce9cce4-a131-445e-8211-ff200c2b8d9c\") "
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291663    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291601    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291829    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291891    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istiod-ca-cert\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291910    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-credential-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291925    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-socket\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.291973 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.291940    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-workload-certs\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.292616 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.292035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:14:14.293331 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.293233    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 02:14:14.293331 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.293302    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 23 02:14:14.293534 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.293515    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:14:14.293589 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.293533    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57" (OuterVolumeSpecName: "kube-api-access-qsh57") pod "8ce9cce4-a131-445e-8211-ff200c2b8d9c" (UID: "8ce9cce4-a131-445e-8211-ff200c2b8d9c"). InnerVolumeSpecName "kube-api-access-qsh57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 02:14:14.393180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.393130    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-token\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.393180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.393172    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-envoy\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.393180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.393182    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsh57\" (UniqueName: \"kubernetes.io/projected/8ce9cce4-a131-445e-8211-ff200c2b8d9c-kube-api-access-qsh57\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.393180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.393193    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-data\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.393500 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.393201    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ce9cce4-a131-445e-8211-ff200c2b8d9c-istio-podinfo\") on node \"ip-10-0-129-17.ec2.internal\" DevicePath \"\""
Jul 23 02:14:14.752952 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.752915    2572 generic.go:356] "Generic (PLEG): container finished" podID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerID="9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb" exitCode=0
Jul 23 02:14:14.753129 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.752985    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"
Jul 23 02:14:14.753129 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.753004    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerDied","Data":"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"}
Jul 23 02:14:14.753129 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.753056    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45" event={"ID":"8ce9cce4-a131-445e-8211-ff200c2b8d9c","Type":"ContainerDied","Data":"828699c3dd5e83ff2562fd859c17bdca64cfa794b75e52de81e6aeaf1903d4af"}
Jul 23 02:14:14.753129 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.753080    2572 scope.go:117] "RemoveContainer" containerID="9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"
Jul 23 02:14:14.763096 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.763070    2572 scope.go:117] "RemoveContainer" containerID="42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"
Jul 23 02:14:14.771224 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.771202    2572 scope.go:117] "RemoveContainer" containerID="9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"
Jul 23 02:14:14.771524 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:14:14.771499    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb\": container with ID starting with 9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb not found: ID does not exist" containerID="9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"
Jul 23 02:14:14.771609 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.771531    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb"} err="failed to get container status \"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb\": rpc error: code = NotFound desc = could not find container \"9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb\": container with ID starting with 9115aab900b2da6bba5b2e9a0eed6e541a761ccb9260f1353687d374750444eb not found: ID does not exist"
Jul 23 02:14:14.771609 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.771550    2572 scope.go:117] "RemoveContainer" containerID="42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"
Jul 23 02:14:14.771804 ip-10-0-129-17 kubenswrapper[2572]: E0723 02:14:14.771788    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5\": container with ID starting with 42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5 not found: ID does not exist" containerID="42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"
Jul 23 02:14:14.771848 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.771808    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5"} err="failed to get container status \"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5\": rpc error: code = NotFound desc = could not find container \"42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5\": container with ID starting with 42bfab0bbf141841d9a17c01e24d5f7a9ee8a202a436250fefc59a37a447dbb5 not found: ID does not exist"
Jul 23 02:14:14.775311 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.775286    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:14:14.778468 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:14.778428    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5fbcb9-openshift-default-7f48bbf467-kqb45"]
Jul 23 02:14:16.330074 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:16.330046    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk_36f69a5d-caf9-4cf7-b89b-a775b6c8cc30/copy-manifests/0.log"
Jul 23 02:14:16.337788 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:16.337760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk_36f69a5d-caf9-4cf7-b89b-a775b6c8cc30/manager/0.log"
Jul 23 02:14:16.715192 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:16.715162    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b7b9f6f57-8ww4w_3a94593a-0d2b-4962-ac53-099ae95df2da/maas-api/0.log"
Jul 23 02:14:16.749375 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:16.749342    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" path="/var/lib/kubelet/pods/8ce9cce4-a131-445e-8211-ff200c2b8d9c/volumes"
Jul 23 02:14:16.962281 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:16.962256    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746200-jjjgq_1acaa8db-cbca-43b2-8863-c04f2c694754/cleanup/0.log"
Jul 23 02:14:18.457716 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:18.457680    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf8cf7d96-t9x7t_4de5b36c-029b-4ed8-9572-e84a9582e39d/authorino/0.log"
Jul 23 02:14:18.591292 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:18.591263    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-59f5l_e3b20c63-da6d-44cc-99eb-dc5dcb454724/manager/0.log"
Jul 23 02:14:18.712040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:18.711970    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vl6j2_141e9e9d-3cb5-4b39-a051-4cfda7ec2366/manager/0.log"
Jul 23 02:14:18.835584 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:18.835561    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qzsw7_834231a5-8607-444d-a1b7-7285c04b3b55/kuadrant-console-plugin/0.log"
Jul 23 02:14:18.964398 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:18.964327    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-44mcj_94a48b13-3149-4221-a299-94227e7997ac/registry-server/0.log"
Jul 23 02:14:19.714239 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:19.714201    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sg29r_42fd63db-c2df-4825-a10d-ec33b7b49993/istio-proxy/0.log"
Jul 23 02:14:20.202785 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:20.202758    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/1.log"
Jul 23 02:14:20.323712 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:20.323688    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-l5gmb_f2b2b9b0-9b7f-4d76-a279-86fcec044868/payload-pre-processing/0.log"
Jul 23 02:14:20.586873 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:20.586799    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-855fd99b4-5vxfg_cd59b648-0a9e-4fcd-a87e-d581a9945b02/router/0.log"
Jul 23 02:14:21.180008 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:21.179980    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sk4pm_29c4dbac-c01e-4b83-8ba3-cf6fa0ac9191/main/0.log"
Jul 23 02:14:21.297972 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:21.297945    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fh9jsl_d14c2165-962f-4acf-b528-28a96d01b191/main/0.log"
Jul 23 02:14:27.755217 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755182    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-54hzb/must-gather-vtwwf"]
Jul 23 02:14:27.755744 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755692    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.755744 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755710    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.755744 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755727    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18dd9fe1-bfc8-462e-b749-f86a870afcdc" containerName="test-curl-7724-140487957267776"
Jul 23 02:14:27.755744 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755737    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18dd9fe1-bfc8-462e-b749-f86a870afcdc" containerName="test-curl-7724-140487957267776"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755752    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755760    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755769    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6fe632-385b-47db-a246-ab6dea2a9afd" containerName="main"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755776    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6fe632-385b-47db-a246-ab6dea2a9afd" containerName="main"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755801    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755810    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755897    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18dd9fe1-bfc8-462e-b749-f86a870afcdc" containerName="test-curl-7724-140487957267776"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755907    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755919    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755929    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6fe632-385b-47db-a246-ab6dea2a9afd" containerName="main"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755937    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.755967 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.755945    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce9cce4-a131-445e-8211-ff200c2b8d9c" containerName="istio-proxy"
Jul 23 02:14:27.756554 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.756044    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.756554 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.756055    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7d8149-4cc8-4050-915f-7372d624cd01" containerName="istio-proxy"
Jul 23 02:14:27.759335 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.759317    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.762622 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.762602    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-54hzb\"/\"default-dockercfg-nz4lg\""
Jul 23 02:14:27.762756 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.762601    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54hzb\"/\"openshift-service-ca.crt\""
Jul 23 02:14:27.762756 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.762642    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-54hzb\"/\"kube-root-ca.crt\""
Jul 23 02:14:27.771493 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.771471    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54hzb/must-gather-vtwwf"]
Jul 23 02:14:27.787842 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.787822    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:27.804040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.804015    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl4jm\" (UniqueName: \"kubernetes.io/projected/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-kube-api-access-jl4jm\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.804153 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.804104    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-must-gather-output\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.878181 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.878148    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log" limit=1024
Jul 23 02:14:27.904633 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.904601    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl4jm\" (UniqueName: \"kubernetes.io/projected/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-kube-api-access-jl4jm\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.904733 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.904687    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-must-gather-output\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.904970 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.904956    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-must-gather-output\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:27.914502 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:27.914480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl4jm\" (UniqueName: \"kubernetes.io/projected/8a4f3429-d4c4-4c16-ad87-b0eac4dbf818-kube-api-access-jl4jm\") pod \"must-gather-vtwwf\" (UID: \"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818\") " pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:28.068760 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:28.068670    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54hzb/must-gather-vtwwf"
Jul 23 02:14:28.203894 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:28.203860    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54hzb/must-gather-vtwwf"]
Jul 23 02:14:28.816232 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:28.816193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54hzb/must-gather-vtwwf" event={"ID":"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818","Type":"ContainerStarted","Data":"2f2c675a73d410d9cc1cf9da40bf6e66b7d022ddb7bf123c4642be3f04014af5"}
Jul 23 02:14:29.824040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:29.823949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54hzb/must-gather-vtwwf" event={"ID":"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818","Type":"ContainerStarted","Data":"fea148c53bf264b06edf46ed48ba810e7b41cec3631924010bd1a77fe1d5a883"}
Jul 23 02:14:29.824040 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:29.824000    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54hzb/must-gather-vtwwf" event={"ID":"8a4f3429-d4c4-4c16-ad87-b0eac4dbf818","Type":"ContainerStarted","Data":"a61b98a160dedf6f2759771ff17b3a8a8cb0cec572a6432f75e8d51856a80641"}
Jul 23 02:14:29.849538 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:29.849468    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-54hzb/must-gather-vtwwf" podStartSLOduration=1.815046476 podStartE2EDuration="2.849429387s" totalImagesPullingTime="1.034382911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 02:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:14:29.847079135 +0000 UTC m=+2781.596138793" watchObservedRunningTime="2026-07-23 02:14:29.849429387 +0000 UTC m=+2781.598489061"
Jul 23 02:14:30.896990 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:30.896954    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dllpf_a69a7473-d4c3-47a4-9d48-4bbb63fb889e/global-pull-secret-syncer/0.log"
Jul 23 02:14:30.990550 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:30.990511    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5t4tc_25a86810-7c0b-4d65-aa87-7e6346a85818/konnectivity-agent/0.log"
Jul 23 02:14:31.088895 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:31.088870    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-17.ec2.internal_dad3ec310531404ccf6f92f1adf8fbff/haproxy/0.log"
Jul 23 02:14:36.370057 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:36.369845    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cf8cf7d96-t9x7t_4de5b36c-029b-4ed8-9572-e84a9582e39d/authorino/0.log"
Jul 23 02:14:36.416747 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:36.416715    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-59f5l_e3b20c63-da6d-44cc-99eb-dc5dcb454724/manager/0.log"
Jul 23 02:14:36.443480 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:36.443454    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vl6j2_141e9e9d-3cb5-4b39-a051-4cfda7ec2366/manager/0.log"
Jul 23 02:14:36.470087 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:36.470049    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qzsw7_834231a5-8607-444d-a1b7-7285c04b3b55/kuadrant-console-plugin/0.log"
Jul 23 02:14:36.517322 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:36.517288    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-44mcj_94a48b13-3149-4221-a299-94227e7997ac/registry-server/0.log"
Jul 23 02:14:38.537185 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:38.537156    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-42j5p_7fb4982d-5610-4864-900a-bf65fc33709c/cluster-monitoring-operator/0.log"
Jul 23 02:14:38.858349 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:38.858259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkrkk_08a1bf35-fe43-4968-93d7-63b69f4d8cf3/node-exporter/0.log"
Jul 23 02:14:38.881953 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:38.881909    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkrkk_08a1bf35-fe43-4968-93d7-63b69f4d8cf3/kube-rbac-proxy/0.log"
Jul 23 02:14:38.902180 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:38.902145    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wkrkk_08a1bf35-fe43-4968-93d7-63b69f4d8cf3/init-textfile/0.log"
Jul 23 02:14:40.647970 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.647920    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"]
Jul 23 02:14:40.653487 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.653463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.660749 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.660722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"]
Jul 23 02:14:40.757262 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.757229    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-sys\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.757478 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.757284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-proc\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.757478 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.757326    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8spzb\" (UniqueName: \"kubernetes.io/projected/2b59760b-af3d-4e34-a78c-80dfbc538272-kube-api-access-8spzb\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.757478 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.757390    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-lib-modules\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.757478 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.757463    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-podres\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858715 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858676    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-podres\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858737    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-sys\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858762    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-proc\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858786    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8spzb\" (UniqueName: \"kubernetes.io/projected/2b59760b-af3d-4e34-a78c-80dfbc538272-kube-api-access-8spzb\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-lib-modules\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858865    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-podres\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858879    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-sys\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.858910 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858881    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-proc\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.859324 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.858942    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b59760b-af3d-4e34-a78c-80dfbc538272-lib-modules\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.866603 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.866572    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8spzb\" (UniqueName: \"kubernetes.io/projected/2b59760b-af3d-4e34-a78c-80dfbc538272-kube-api-access-8spzb\") pod \"perf-node-gather-daemonset-t2l2f\" (UID: \"2b59760b-af3d-4e34-a78c-80dfbc538272\") " pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:40.966231 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:40.965994    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:41.149179 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.149084    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"]
Jul 23 02:14:41.173736 ip-10-0-129-17 kubenswrapper[2572]: W0723 02:14:41.173430    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b59760b_af3d_4e34_a78c_80dfbc538272.slice/crio-216b4612fca9c5415f374d92787c04ed00437659f188c31118828a953d4dec0a WatchSource:0}: Error finding container 216b4612fca9c5415f374d92787c04ed00437659f188c31118828a953d4dec0a: Status 404 returned error can't find the container with id 216b4612fca9c5415f374d92787c04ed00437659f188c31118828a953d4dec0a
Jul 23 02:14:41.293366 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.293341    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/2.log"
Jul 23 02:14:41.299646 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.299624    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-2qmm2_47e0cccc-44ce-4404-926a-586e3295e4aa/console-operator/3.log"
Jul 23 02:14:41.908228 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.908186    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f" event={"ID":"2b59760b-af3d-4e34-a78c-80dfbc538272","Type":"ContainerStarted","Data":"9e192d10d5c9676f275accdc92821e0b873cdcd83a0db373ea056a67f671744f"}
Jul 23 02:14:41.908763 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.908254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f" event={"ID":"2b59760b-af3d-4e34-a78c-80dfbc538272","Type":"ContainerStarted","Data":"216b4612fca9c5415f374d92787c04ed00437659f188c31118828a953d4dec0a"}
Jul 23 02:14:41.909091 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:41.909065    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:42.497888 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:42.497848    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-fjvxl_6fd6d7af-60b7-469b-8c62-bd0baa77077b/volume-data-source-validator/0.log"
Jul 23 02:14:43.495113 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:43.495081    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5d624_aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2/dns/0.log"
Jul 23 02:14:43.513790 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:43.513760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5d624_aeb49ca9-8ad9-404c-99d8-33d6f6dd98a2/kube-rbac-proxy/0.log"
Jul 23 02:14:43.652318 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:43.652286    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjtnk_baddff25-c286-4cec-ad32-4c9ff83a2dba/dns-node-resolver/0.log"
Jul 23 02:14:44.266383 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:44.266357    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bxp7v_4770b03e-179a-4468-b3b9-cd2466e2a664/node-ca/0.log"
Jul 23 02:14:45.186775 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:45.186743    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sg29r_42fd63db-c2df-4825-a10d-ec33b7b49993/istio-proxy/0.log"
Jul 23 02:14:45.386366 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:45.386325    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/0.log"
Jul 23 02:14:45.424429 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:45.424377    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/1.log"
Jul 23 02:14:45.456555 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:45.456465    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-l5gmb_f2b2b9b0-9b7f-4d76-a279-86fcec044868/payload-pre-processing/0.log"
Jul 23 02:14:45.508791 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:45.508760    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-855fd99b4-5vxfg_cd59b648-0a9e-4fcd-a87e-d581a9945b02/router/0.log"
Jul 23 02:14:46.170864 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.170836    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9jz9j_9795fa52-04c5-454b-80aa-ee5d416b9a87/serve-healthcheck-canary/0.log"
Jul 23 02:14:46.687015 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.686953    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-l2zcp_6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11/insights-operator/0.log"
Jul 23 02:14:46.688093 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.688071    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-l2zcp_6a81b7cc-dd4d-4ac7-837f-a1c586c0ed11/insights-operator/1.log"
Jul 23 02:14:46.838866 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.838827    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zclsn_54dadbdf-ddbe-46c7-875b-0de782b2daf0/kube-rbac-proxy/0.log"
Jul 23 02:14:46.857808 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.857781    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zclsn_54dadbdf-ddbe-46c7-875b-0de782b2daf0/exporter/0.log"
Jul 23 02:14:46.881575 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:46.881542    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zclsn_54dadbdf-ddbe-46c7-875b-0de782b2daf0/extractor/0.log"
Jul 23 02:14:48.932569 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:48.932538    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f"
Jul 23 02:14:48.951656 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:48.951594    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-54hzb/perf-node-gather-daemonset-t2l2f" podStartSLOduration=8.95157289 podStartE2EDuration="8.95157289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 02:14:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 02:14:41.926372548 +0000 UTC m=+2793.675432221" watchObservedRunningTime="2026-07-23 02:14:48.95157289 +0000 UTC m=+2800.700632562"
Jul 23 02:14:49.575733 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:49.575708    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk_36f69a5d-caf9-4cf7-b89b-a775b6c8cc30/manager/0.log"
Jul 23 02:14:49.598663 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:49.598630    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bf9cbfb7c-rxrjk_36f69a5d-caf9-4cf7-b89b-a775b6c8cc30/copy-manifests/0.log"
Jul 23 02:14:51.024797 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.024743    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7564d6dfb8-hcz5r_91394b0d-3ca1-40e8-83e5-f5cdca65a605/manager/0.log"
Jul 23 02:14:51.525500 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.525428    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sg29r_42fd63db-c2df-4825-a10d-ec33b7b49993/istio-proxy/0.log"
Jul 23 02:14:51.714416 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.714369    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/0.log"
Jul 23 02:14:51.751707 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.751669    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/1.log"
Jul 23 02:14:51.783174 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.783133    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-l5gmb_f2b2b9b0-9b7f-4d76-a279-86fcec044868/payload-pre-processing/0.log"
Jul 23 02:14:51.817886 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:51.817858    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-855fd99b4-5vxfg_cd59b648-0a9e-4fcd-a87e-d581a9945b02/router/0.log"
Jul 23 02:14:52.924411 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:52.924379    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4sg29r_42fd63db-c2df-4825-a10d-ec33b7b49993/istio-proxy/0.log"
Jul 23 02:14:53.120823 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:53.120785    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/0.log"
Jul 23 02:14:53.158447 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:53.158402    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-rwx9n_2d53130c-ace9-4fdc-9c66-7e5d060670e5/istio-proxy/1.log"
Jul 23 02:14:53.184506 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:53.184416    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-l5gmb_f2b2b9b0-9b7f-4d76-a279-86fcec044868/payload-pre-processing/0.log"
Jul 23 02:14:53.230335 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:53.230306    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-855fd99b4-5vxfg_cd59b648-0a9e-4fcd-a87e-d581a9945b02/router/0.log"
Jul 23 02:14:56.633938 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:56.633897    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-5f6qj_960736d3-2bff-4ee9-94c2-0e6600842f0e/kube-storage-version-migrator-operator/1.log"
Jul 23 02:14:56.635025 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:56.634997    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-5f6qj_960736d3-2bff-4ee9-94c2-0e6600842f0e/kube-storage-version-migrator-operator/0.log"
Jul 23 02:14:57.652895 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.652864    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/kube-multus-additional-cni-plugins/0.log"
Jul 23 02:14:57.673835 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.673806    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/egress-router-binary-copy/0.log"
Jul 23 02:14:57.694814 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.694788    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/cni-plugins/0.log"
Jul 23 02:14:57.714534 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.714502    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/bond-cni-plugin/0.log"
Jul 23 02:14:57.734214 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.734184    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/routeoverride-cni/0.log"
Jul 23 02:14:57.757276 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.757246    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/whereabouts-cni-bincopy/0.log"
Jul 23 02:14:57.777452 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:57.777409    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dlzwg_48cb9123-c805-44cf-a0f0-1dd46158c078/whereabouts-cni/0.log"
Jul 23 02:14:58.192177 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:58.192147    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ndbjh_b9783d7b-260d-457a-8597-77a2a80d9a2e/kube-multus/0.log"
Jul 23 02:14:58.212812 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:58.212783    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cfrth_8e3962fb-66de-43fa-b837-57ece6d1d56c/network-metrics-daemon/0.log"
Jul 23 02:14:58.230395 ip-10-0-129-17 kubenswrapper[2572]: I0723 02:14:58.230365    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cfrth_8e3962fb-66de-43fa-b837-57ece6d1d56c/kube-rbac-proxy/0.log"