Jul 17 16:26:04.768488 ip-10-0-134-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 16:26:05.180887 ip-10-0-134-12 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:26:05.180887 ip-10-0-134-12 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 16:26:05.180887 ip-10-0-134-12 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:26:05.180887 ip-10-0-134-12 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 16:26:05.180887 ip-10-0-134-12 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 16:26:05.182065 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.180946    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186854    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186879    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186883    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186886    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186889    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186892    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.186883 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186895    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186898    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186901    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186903    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186906    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186911    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186916    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186918    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186921    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186924    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186926    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186929    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186931    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186934    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186936    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186939    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186941    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186943    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186946    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.187153 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186949    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186953    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186957    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186960    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186962    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186971    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186974    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186978    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186980    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186982    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186985    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186987    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186990    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186992    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186994    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.186997    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187000    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187003    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187005    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187008    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.187644 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187010    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187013    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187015    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187018    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187020    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187022    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187025    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187027    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187030    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187032    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187035    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187037    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187041    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187046    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187048    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187051    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187053    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187057    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187060    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187062    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.188155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187065    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187067    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187070    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187073    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187076    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187078    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187082    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187085    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187087    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187090    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187092    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187094    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187097    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187100    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187102    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187104    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187107    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187109    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187113    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187116    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.188638 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187118    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187137    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187140    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187143    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187145    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187148    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187150    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187153    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187155    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187158    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187161    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187163    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187166    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187169    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187940    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187947    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187951    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187954    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187957    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187961    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.189119 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187964    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187966    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187969    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187971    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187974    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187977    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187979    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187982    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187986    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187990    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187993    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.187997    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188000    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188003    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188006    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188008    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188011    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188013    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188015    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.189622 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188018    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188021    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188024    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188026    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188029    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188032    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188034    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188036    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188039    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188041    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188044    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188047    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188050    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188052    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188055    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188057    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188060    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188062    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188064    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.190155 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188066    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188070    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188072    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188076    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188080    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188082    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188086    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188089    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188091    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188094    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188097    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188099    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188102    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188104    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188106    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188108    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188111    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188114    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188116    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.190629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188118    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188136    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188139    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188141    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188143    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188147    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188150    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188153    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188156    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188158    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188161    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188164    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188166    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188169    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188172    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188177    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188181    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188185    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188187    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.191087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188190    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188193    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188196    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188198    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188201    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188204    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188207    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188209    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188212    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188214    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188217    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188219    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188222    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188224    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188226    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188229    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188231    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188638    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188644    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188648    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.191575 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188651    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188653    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188656    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188659    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188661    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188664    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188666    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188669    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188672    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188674    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188677    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188679    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188681    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188684    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188689    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188692    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188695    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188698    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188700    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.192066 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188703    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188705    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188709    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188711    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188713    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188716    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188718    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188720    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188723    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188725    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188727    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188730    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188733    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188753    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188756    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188759    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188762    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188765    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188767    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188770    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.192535 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188772    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188774    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188777    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188779    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188782    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188784    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188786    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188789    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188792    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188795    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188797    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188799    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188801    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188804    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188806    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188808    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188811    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188813    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188815    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188818    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.193020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188820    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188822    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188824    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188827    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188832    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188836    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188838    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188841    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188843    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188846    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188848    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188850    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188853    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188855    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188858    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188860    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188863    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188865    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188867    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188870    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.193514 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188873    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188877    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188880    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188883    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188886    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188888    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188891    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188893    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188896    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188898    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188901    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188903    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188906    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188908    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188910    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188914    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.188917    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.188991    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189001    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189011    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 16:26:05.194004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189018    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189025    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189030    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189050    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189055    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189058    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189061    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189064    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189068    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189071    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189073    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189076    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189079    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189083    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189086    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189091    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189093    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189096    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189099    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189103    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189106    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189109    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189112    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 16:26:05.194507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189115    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189118    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189134    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189137    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189140    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189145    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189150    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189153    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189156    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189158    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189161    2558 flags.go:64] FLAG: --enable-server="true"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189164    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189169    2558 flags.go:64] FLAG: --event-burst="100"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189172    2558 flags.go:64] FLAG: --event-qps="50"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189175    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189178    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189181    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189185    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189187    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189190    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189201    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189204    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189207    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189215    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189218    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 16:26:05.195050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189221    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189224    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189227    2558 flags.go:64] FLAG: --feature-gates=""
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189231    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189234    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189237    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189240    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189242    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189245    2558 flags.go:64] FLAG: --help="false"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189248    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189251    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189254    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189259    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189262    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189265    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189268    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189271    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189273    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189276    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189279    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189282    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189284    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189287    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189290    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 16:26:05.195729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189293    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189296    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189301    2558 flags.go:64] FLAG: --lock-file=""
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189305    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189310    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189314    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189323    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189329    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189333    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189335    2558 flags.go:64] FLAG: --logging-format="text"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189338    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189342    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189344    2558 flags.go:64] FLAG: --manifest-url=""
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189347    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189352    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189355    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189359    2558 flags.go:64] FLAG: --max-pods="110"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189361    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189364    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189367    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189371    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189374    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189378    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189380    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189388    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 16:26:05.196371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189391    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189394    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189397    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189400    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189405    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189407    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189411    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189413    2558 flags.go:64] FLAG: --port="10250"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189416    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189419    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061fda09d6ae10fee"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189422    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189425    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189427    2558 flags.go:64] FLAG: --register-node="true"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189430    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189434    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189447    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189450    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189454    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189462    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189465    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189467    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189470    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189473    2558 flags.go:64] FLAG: --runonce="false"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189475    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189479    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 16:26:05.197004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189481    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189484    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189487    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189491    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189494    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189497    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189500    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189502    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189505    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189508    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189511    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189513    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189516    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189521    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189524    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189527    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189531    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189534    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189536    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189539    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189541    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189544    2558 flags.go:64] FLAG: --v="2"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189549    2558 flags.go:64] FLAG: --version="false"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189554    2558 flags.go:64] FLAG: --vmodule=""
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189560    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 16:26:05.197637 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.189563    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189694    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189698    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189701    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189703    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189706    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189708    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189711    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189713    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189715    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189719    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189722    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189724    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189727    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189729    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189732    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189734    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189737    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189739    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189742    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.198287 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189744    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189748    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189752    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189754    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189757    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189759    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189762    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189764    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189767    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189769    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189772    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189777    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189779    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189782    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189784    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189786    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189789    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189792    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189795    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.198813 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189797    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189800    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189802    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189806    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189808    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189811    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189816    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189818    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189821    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189824    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189826    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189829    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189831    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189833    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189837    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189841    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189844    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189847    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.199329 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189850    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189853    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189856    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189860    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189863    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189867    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189870    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189873    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189875    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189878    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189880    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189882    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189885    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189887    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189890    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189892    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189896    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189898    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189901    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189904    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.199788 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189906    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189909    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189911    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189914    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189916    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189918    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189921    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189923    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189926    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189928    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189930    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189933    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189935    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189938    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189940    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189943    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189945    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189949    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189952    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189957    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189960    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.200288 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.189962    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.190885    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.197774    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.197793    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.198642    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.198651    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198710    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198717    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198721    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198724    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198727    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198729    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198732    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198734    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.200874 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198737    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198739    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198742    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198745    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198747    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198750    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198753    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198755    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198758    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198761    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198763    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198766    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198768    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198771    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198774    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198776    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198778    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198781    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198783    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198786    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.201253 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198789    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198792    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198795    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198797    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198800    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198802    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198804    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198807    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198811    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198815    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198818    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198821    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198823    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198826    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198829    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198832    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198835    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198837    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198840    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.201730 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198843    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198845    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198847    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198850    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198852    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198855    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198858    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198861    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198863    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198865    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198868    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198871    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198873    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198876    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198879    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198881    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198884    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198886    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198889    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198891    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.202202 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198894    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198896    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198898    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198901    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198903    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198906    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198908    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198910    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198913    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198915    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198918    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198920    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198923    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198925    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198928    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198931    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198934    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198937    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198939    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198942    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.202766 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198944    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198947    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198949    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198951    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198954    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198957    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198959    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198962    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198965    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198967    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198970    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.198972    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.198977    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199096    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199100    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 16:26:05.203426 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199103    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199105    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199108    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199111    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199114    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199119    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199137    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199140    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199143    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199146    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199148    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199151    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199153    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199156    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199158    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199161    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199163    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199166    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199169    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 16:26:05.203803 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199171    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199174    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199177    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199179    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199183    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199186    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199189    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199192    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199195    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199198    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199200    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199202    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199205    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199207    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199210    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199212    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199215    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199217    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199219    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 16:26:05.204319 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199222    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199224    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199226    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199229    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199232    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199235    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199237    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199239    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199242    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199244    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199246    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199249    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199252    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199254    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199257    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199260    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199262    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199264    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199267    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199269    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 16:26:05.204780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199272    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199274    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199277    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199280    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199282    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199285    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199287    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199289    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199292    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199294    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199297    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199299    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199301    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199304    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199306    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199309    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199311    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199313    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199317    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199321    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 16:26:05.205295 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199323    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199326    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199329    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199332    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199335    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199338    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199341    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199344    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199346    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199348    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199351    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199353    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199356    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199358    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199361    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199364    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199366    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199368    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 16:26:05.205774 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:05.199371    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.199376    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.199505    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.202531    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.203791    2558 server.go:1019] "Starting client certificate rotation"
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.203896    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.203929    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 16:26:05.206232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.206228    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 16:26:05.211489 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.211463    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 16:26:05.219266 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.219249    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 17 16:26:05.221547 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.221533    2558 log.go:25] "Validated CRI v1 image API"
Jul 17 16:26:05.223201 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.223188    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 16:26:05.227293 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.227266    2558 fs.go:135] Filesystem UUIDs: map[2e2a59f8-f52b-4af6-9b38-311c9f6f6798:/dev/nvme0n1p4 51a40109-aac7-4b3c-85d3-d8e7f18a7a40:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 17 16:26:05.227375 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.227291    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 16:26:05.232587 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.232466    2558 manager.go:216] Machine: {Timestamp:2026-07-17 16:26:05.231028657 +0000 UTC m=+0.343571234 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099002 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec291a082669e3b28b3b209e92ef4234 SystemUUID:ec291a08-2669-e3b2-8b3b-209e92ef4234 BootID:d445f28c-2745-4dcb-9922-bd1c3c211ba9 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:a7:49:62:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:a7:49:62:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:04:8a:96:79:bc Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 16:26:05.232587 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.232583    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 16:26:05.232712 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.232676    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 16:26:05.235987 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.235947    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 16:26:05.236188 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.235991    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 16:26:05.237161 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.237149    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 16:26:05.237200 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.237164    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 16:26:05.237200 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.237171    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 16:26:05.237805 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.237795    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 16:26:05.239087 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.239077    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 16:26:05.242846 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.242814    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 16:26:05.242937 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.242919    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 16:26:05.243068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243058    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 16:26:05.243099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243090    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 16:26:05.243139 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243105    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 16:26:05.243139 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243135    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 16:26:05.243197 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243145    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 17 16:26:05.243197 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243155    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 16:26:05.243564 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243552    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 16:26:05.243611 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.243573    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 16:26:05.245774 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.245754    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 16:26:05.247498 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.247485    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 16:26:05.247540 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.247517    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 16:26:05.248506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248477    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 16:26:05.248506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248505    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248519    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248528    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248544    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248554    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248569    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248580    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248593    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248601    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248617    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 16:26:05.248644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.248627    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 16:26:05.250150 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.250138    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 16:26:05.250189 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.250151    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 16:26:05.253435 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.253421    2558 server.go:1268] "Started kubelet"
Jul 17 16:26:05.253521 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.253484    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 16:26:05.253804 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.253670    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 16:26:05.253912 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.253902    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 16:26:05.257975 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.257938    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 16:26:05.258350 ip-10-0-134-12 systemd[1]: Started Kubernetes Kubelet.
Jul 17 16:26:05.259703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.259576    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 17 16:26:05.259761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.259641    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 17 16:26:05.259821 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.259682    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 17 16:26:05.260774 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.260748    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 16:26:05.261709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.261695    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 16:26:05.264155 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.263207    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-12.ec2.internal.18c320753bae60ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-12.ec2.internal,UID:ip-10-0-134-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-12.ec2.internal,},FirstTimestamp:2026-07-17 16:26:05.253394634 +0000 UTC m=+0.365937200,LastTimestamp:2026-07-17 16:26:05.253394634 +0000 UTC m=+0.365937200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-12.ec2.internal,}"
Jul 17 16:26:05.266832 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.266816    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 16:26:05.266903 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.266837    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 16:26:05.266948 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.266928    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.267444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.267430    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 16:26:05.267575 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.267564    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 16:26:05.267658 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.267591    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 16:26:05.267751 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.267739    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 16:26:05.267751 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.267751    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 16:26:05.268648 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268630    2558 factory.go:55] Registering systemd factory
Jul 17 16:26:05.268648 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268652    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 17 16:26:05.268923 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268898    2558 factory.go:153] Registering CRI-O factory
Jul 17 16:26:05.268923 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268914    2558 factory.go:223] Registration of the crio container factory successfully
Jul 17 16:26:05.269065 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268966    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 16:26:05.269065 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.268990    2558 factory.go:103] Registering Raw factory
Jul 17 16:26:05.269065 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.269004    2558 manager.go:1196] Started watching for new ooms in manager
Jul 17 16:26:05.269491 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.269435    2558 manager.go:349] Starting recovery of all containers
Jul 17 16:26:05.279770 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.279592    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 17 16:26:05.279938 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.279906    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 17 16:26:05.280875 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.280855    2558 manager.go:354] Recovery completed
Jul 17 16:26:05.286625 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.286613    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.288729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.288709    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.288811 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.288743    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.288811 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.288753    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.289367 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.289354    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 16:26:05.289367 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.289366    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 16:26:05.289496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.289368    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.289496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.289381    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 16:26:05.290218 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290179    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.290309 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290235    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.290309 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290252    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.290708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290696    2558 policy_none.go:49] "None policy: Start"
Jul 17 16:26:05.290763 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290713    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 16:26:05.290763 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.290722    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 16:26:05.291944 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.291933    2558 policy_none.go:47] "Start"
Jul 17 16:26:05.294934 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.294852    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-12.ec2.internal.18c320753dc986ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-12.ec2.internal,UID:ip-10-0-134-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-12.ec2.internal,},FirstTimestamp:2026-07-17 16:26:05.288728301 +0000 UTC m=+0.401270871,LastTimestamp:2026-07-17 16:26:05.288728301 +0000 UTC m=+0.401270871,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-12.ec2.internal,}"
Jul 17 16:26:05.311356 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.311260    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-12.ec2.internal.18c320753dc9d19d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-12.ec2.internal,UID:ip-10-0-134-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-12.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-12.ec2.internal,},FirstTimestamp:2026-07-17 16:26:05.288747421 +0000 UTC m=+0.401289990,LastTimestamp:2026-07-17 16:26:05.288747421 +0000 UTC m=+0.401289990,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-12.ec2.internal,}"
Jul 17 16:26:05.322001 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.321979    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c2mbh"
Jul 17 16:26:05.327195 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.327080    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-12.ec2.internal.18c320753dc9f70f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-12.ec2.internal,UID:ip-10-0-134-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-12.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-12.ec2.internal,},FirstTimestamp:2026-07-17 16:26:05.288757007 +0000 UTC m=+0.401299574,LastTimestamp:2026-07-17 16:26:05.288757007 +0000 UTC m=+0.401299574,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-12.ec2.internal,}"
Jul 17 16:26:05.327785 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.327772    2558 manager.go:337] "Starting Device Plugin manager"
Jul 17 16:26:05.327879 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.327812    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 16:26:05.327879 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.327822    2558 server.go:87] "Starting device plugin registration server"
Jul 17 16:26:05.328178 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.328165    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 16:26:05.328248 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.328180    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 16:26:05.328316 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.328272    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 16:26:05.328376 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.328363    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 16:26:05.328431 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.328376    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 16:26:05.328887 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.328863    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 16:26:05.328981 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.328925    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.340452 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.340373    2558 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-12.ec2.internal.18c320753dc986ed\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-12.ec2.internal.18c320753dc986ed  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-12.ec2.internal,UID:ip-10-0-134-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-12.ec2.internal,},FirstTimestamp:2026-07-17 16:26:05.288728301 +0000 UTC m=+0.401270871,LastTimestamp:2026-07-17 16:26:05.290217739 +0000 UTC m=+0.402760310,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-12.ec2.internal,}"
Jul 17 16:26:05.340757 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.340740    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c2mbh"
Jul 17 16:26:05.406515 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.406475    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 16:26:05.407902 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.407866    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 16:26:05.407960 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.407907    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 16:26:05.407960 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.407930    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 16:26:05.408032 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.407967    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 16:26:05.410529 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.410504    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:26:05.428464 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.428435    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.429603 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.429587    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.429694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.429620    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.429694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.429635    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.429694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.429660    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.439699 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.439640    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.439699 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.439665    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-12.ec2.internal\": node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.455415 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.455393    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.508630 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.508605    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"]
Jul 17 16:26:05.508722 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.508690    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.509653 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.509635    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.509708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.509669    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.509708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.509679    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.511073 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511058    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.511195 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511179    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.511235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511215    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.511894 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511876    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.512005 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511909    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.512005 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511923    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.512005 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511876    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.512005 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.511988    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.512005 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.512001    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.513358 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.513342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.513441 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.513372    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:05.514049 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.514027    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:05.514109 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.514063    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:05.514109 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.514078    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:05.528670 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.528649    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-12.ec2.internal\" not found" node="ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.532180 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.532165    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-12.ec2.internal\" not found" node="ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.555521 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.555498    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.569696 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.569659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.569696 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.569694    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5784c315c79fb4bd1f99b0628dd3ba86-config\") pod \"kube-apiserver-proxy-ip-10-0-134-12.ec2.internal\" (UID: \"5784c315c79fb4bd1f99b0628dd3ba86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.569864 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.569711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.655631 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.655603    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.670611 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670578    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5784c315c79fb4bd1f99b0628dd3ba86-config\") pod \"kube-apiserver-proxy-ip-10-0-134-12.ec2.internal\" (UID: \"5784c315c79fb4bd1f99b0628dd3ba86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.670686 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.670686 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.670763 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5784c315c79fb4bd1f99b0628dd3ba86-config\") pod \"kube-apiserver-proxy-ip-10-0-134-12.ec2.internal\" (UID: \"5784c315c79fb4bd1f99b0628dd3ba86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.670763 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670753    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.670832 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.670788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49e085301fad9f39888ed44453973a3b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal\" (UID: \"49e085301fad9f39888ed44453973a3b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.756505 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.756438    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.834810 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.834760    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.835961 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:05.835945    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:05.856710 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.856685    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:05.961314 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:05.961266    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.068667 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:06.068569    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.169229 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:06.169181    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.205135 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.205112    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 16:26:06.205697 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.205266    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 16:26:06.269571 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:06.269536    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.344862 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.344782    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 16:21:05 +0000 UTC" deadline="2028-03-11 00:04:00.27016717 +0000 UTC"
Jul 17 16:26:06.344862 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.344826    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14455h37m53.925349554s"
Jul 17 16:26:06.370665 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:06.370623    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.433792 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.433762    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 16:26:06.434953 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.434931    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 16:26:06.435090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.434971    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 16:26:06.435090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.434987    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeHasSufficientPID"
Jul 17 16:26:06.471671 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:06.471637    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-12.ec2.internal\" not found"
Jul 17 16:26:06.474516 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:06.474472    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5784c315c79fb4bd1f99b0628dd3ba86.slice/crio-e8c015b54051dc7d2718a3856ddb28d1caeea5ed745b1d2b778a4bf50685523f WatchSource:0}: Error finding container e8c015b54051dc7d2718a3856ddb28d1caeea5ed745b1d2b778a4bf50685523f: Status 404 returned error can't find the container with id e8c015b54051dc7d2718a3856ddb28d1caeea5ed745b1d2b778a4bf50685523f
Jul 17 16:26:06.474698 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:06.474684    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e085301fad9f39888ed44453973a3b.slice/crio-44e2e00c0d03b2937dd4ba498e1aeb31d24d185abe11f3e3b4e3b76e1ce79199 WatchSource:0}: Error finding container 44e2e00c0d03b2937dd4ba498e1aeb31d24d185abe11f3e3b4e3b76e1ce79199: Status 404 returned error can't find the container with id 44e2e00c0d03b2937dd4ba498e1aeb31d24d185abe11f3e3b4e3b76e1ce79199
Jul 17 16:26:06.479281 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.479261    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:26:06.501705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.501671    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:26:06.567419 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.567368    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:06.580949 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.580922    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 16:26:06.582994 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.582974    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal"
Jul 17 16:26:06.592716 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.592693    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 16:26:06.660253 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.660231    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:26:06.847319 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:06.847288    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:26:07.191189 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.191116    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 16:26:07.244438 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.244401    2558 apiserver.go:52] "Watching apiserver"
Jul 17 16:26:07.250568 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.250535    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 16:26:07.253674 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.253638    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-zt999","kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5","openshift-cluster-node-tuning-operator/tuned-hzzr5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal","openshift-multus/multus-additional-cni-plugins-gk7df","openshift-multus/network-metrics-daemon-d5vch","openshift-dns/node-resolver-mk9jg","openshift-image-registry/node-ca-m7vf9","openshift-multus/multus-dhxdq","openshift-network-diagnostics/network-check-target-kwxbx","openshift-network-operator/iptables-alerter-ccwcd","openshift-ovn-kubernetes/ovnkube-node-mjwb8","kube-system/global-pull-secret-syncer-cqmvb"]
Jul 17 16:26:07.255284 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.255255    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.255414 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.255338    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:07.256596 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.256575    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:07.256699 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.256637    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:07.257952 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.257928    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.260327 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.260299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.260584 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.260564    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 16:26:07.260748 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.260727    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.260852 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.260799    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:07.261020 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.260972    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x4qfp\""
Jul 17 16:26:07.261020 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.260988    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.261195 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.261081    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.262699 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.261884    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.263079 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.263055    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.263079 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.263075    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b4l6l\""
Jul 17 16:26:07.263079 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.263091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.264160 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.264119    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.264305 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.264285    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nrrzb\""
Jul 17 16:26:07.265037 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.265018    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 16:26:07.266183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.265231    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.266183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.265458    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 16:26:07.266183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.265693    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 16:26:07.266814 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.266793    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.267043 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.267026    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.268672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.268002    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 16:26:07.270307 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.270287    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.270599 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.270583    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mn58z\""
Jul 17 16:26:07.270819 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.270803    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.271323 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.271293    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 16:26:07.271628 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.271598    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gjqr8\""
Jul 17 16:26:07.271731 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.271714    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.271898 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.271874    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 16:26:07.273920 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.273895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.273920 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.273910    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 16:26:07.274395 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.274375    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.274757 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.272096    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 16:26:07.275814 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.275794    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 16:26:07.276341 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.276320    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.276430 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.276385    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.276618 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.276595    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.278082 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.277374    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.278082 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.277609    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 16:26:07.278323 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.278299    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tg4hr\""
Jul 17 16:26:07.278900 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.278872    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mxr8t\""
Jul 17 16:26:07.279115 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.279093    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.280463 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.280417    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 16:26:07.281088 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.281068    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:26:07.281309 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.281290    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pfmv4\""
Jul 17 16:26:07.281510 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.281492    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 16:26:07.281719 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.281701    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wxfgw\""
Jul 17 16:26:07.281927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.281915    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 16:26:07.282234 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.282217    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 16:26:07.283923 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.283870    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.283925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-conf\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.283952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-ovn\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.283978    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-var-lib-kubelet\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-host\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8cd8\" (UniqueName: \"kubernetes.io/projected/5223a0b4-ae1e-4100-9573-48ed5f55f20e-kube-api-access-n8cd8\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284068    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8ctg\" (UniqueName: \"kubernetes.io/projected/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kube-api-access-j8ctg\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284095    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prrhd\" (UniqueName: \"kubernetes.io/projected/2bd52190-ca3b-4aff-a812-e11908b5b960-kube-api-access-prrhd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284174    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-modprobe-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284264    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-dbus\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284288    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-cnibin\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-env-overrides\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-hosts-file\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284398    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5223a0b4-ae1e-4100-9573-48ed5f55f20e-serviceca\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-node-log\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284449    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn66\" (UniqueName: \"kubernetes.io/projected/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-kube-api-access-7dn66\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.284503 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284482    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-systemd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-bin\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284562    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-tmp\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284613    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284637    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysconfig\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284662    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-systemd\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-device-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-log-socket\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284775    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xd5j\" (UniqueName: \"kubernetes.io/projected/e1d07af1-19e5-40ac-9fed-97b43510b195-kube-api-access-5xd5j\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-var-lib-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284825    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62r6n\" (UniqueName: \"kubernetes.io/projected/77024620-0563-4b23-9fec-b1f43193e81e-kube-api-access-62r6n\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284854    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284879    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-kubernetes\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.284988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284906    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tjhl\" (UniqueName: \"kubernetes.io/projected/09e968f1-1e24-4c17-a260-81a7fb18e98e-kube-api-access-9tjhl\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-system-cni-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.284976    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-os-release\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-kubelet\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285026    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-netd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285052    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bd52190-ca3b-4aff-a812-e11908b5b960-ovn-node-metrics-cert\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-lib-modules\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-tuned\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-sys\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.285761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.285185    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.286168 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-systemd-units\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286168 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-script-lib\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286294 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286189    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.286294 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286236    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5223a0b4-ae1e-4100-9573-48ed5f55f20e-host\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.286294 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-netns\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286294 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286284    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-config\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286309    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-slash\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286360    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-tmp-dir\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-etc-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.286501 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-kubelet-config\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.286820 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-run\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.286820 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286527    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.286820 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.286593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:07.287559 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.287484    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 16:26:07.308067 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.308031    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-p2gnb"
Jul 17 16:26:07.319885 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.319858    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-p2gnb"
Jul 17 16:26:07.368518 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.368487    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 16:26:07.387821 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.387821 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysconfig\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-systemd\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-device-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387900    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-log-socket\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysconfig\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.387953    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-netns\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-systemd\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388007    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-bin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388031    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-socket-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388050    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-log-socket\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388036    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4k2x\" (UniqueName: \"kubernetes.io/projected/4a4e786f-0764-4b3b-82f2-d709a8217c89-kube-api-access-c4k2x\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-device-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xd5j\" (UniqueName: \"kubernetes.io/projected/e1d07af1-19e5-40ac-9fed-97b43510b195-kube-api-access-5xd5j\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-var-lib-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388183    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62r6n\" (UniqueName: \"kubernetes.io/projected/77024620-0563-4b23-9fec-b1f43193e81e-kube-api-access-62r6n\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-daemon-config\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388293    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-kubernetes\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tjhl\" (UniqueName: \"kubernetes.io/projected/09e968f1-1e24-4c17-a260-81a7fb18e98e-kube-api-access-9tjhl\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388347    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-system-cni-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-os-release\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-kubelet\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-netd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bd52190-ca3b-4aff-a812-e11908b5b960-ovn-node-metrics-cert\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-lib-modules\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.388542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-tuned\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-sys\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388544    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-systemd-units\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388596    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-script-lib\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5223a0b4-ae1e-4100-9573-48ed5f55f20e-host\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-netns\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388698    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-var-lib-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388718    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-config\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388757    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-multus-certs\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-slash\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388837    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-k8s-cni-cncf-io\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388864    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-kubelet\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388891    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-tmp-dir\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.389403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-os-release\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388959    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388970    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-socket-dir-parent\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.388997    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmxh\" (UniqueName: \"kubernetes.io/projected/c40893da-a551-4fc7-8762-0efb79720932-kube-api-access-8mmxh\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389017    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-kubernetes\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389025    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-etc-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-kubelet-config\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389064    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5223a0b4-ae1e-4100-9573-48ed5f55f20e-host\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-run\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389108    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ff89ab6-7072-4bbc-a35b-d393540dfc67-konnectivity-ca\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389165    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389197    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-os-release\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-conf-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389240    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389245    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-kubelet\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389268    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-conf\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-netd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389294    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-ovn\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-hostroot\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389356    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ff89ab6-7072-4bbc-a35b-d393540dfc67-agent-certs\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389386    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-var-lib-kubelet\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389411    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-host\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389427    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-lib-modules\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389438    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8cd8\" (UniqueName: \"kubernetes.io/projected/5223a0b4-ae1e-4100-9573-48ed5f55f20e-kube-api-access-n8cd8\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-cnibin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389488    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-multus\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-etc-kubernetes\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389574    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8ctg\" (UniqueName: \"kubernetes.io/projected/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kube-api-access-j8ctg\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389688    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389716    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prrhd\" (UniqueName: \"kubernetes.io/projected/2bd52190-ca3b-4aff-a812-e11908b5b960-kube-api-access-prrhd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389748    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389760    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 16:26:07.390738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389776    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-modprobe-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-dbus\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389829    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-cnibin\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-env-overrides\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389874    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-hosts-file\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389898    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-system-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389923    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-cni-binary-copy\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c40893da-a551-4fc7-8762-0efb79720932-iptables-alerter-script\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390033    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5223a0b4-ae1e-4100-9573-48ed5f55f20e-serviceca\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390061    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-node-log\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390087    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn66\" (UniqueName: \"kubernetes.io/projected/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-kube-api-access-7dn66\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390112    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40893da-a551-4fc7-8762-0efb79720932-host-slash\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-systemd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-bin\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390215    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-tmp\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.391303 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.390414    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-netns\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390452    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-sys\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.390491    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:07.890467809 +0000 UTC m=+3.003010366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-slash\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-var-lib-kubelet\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-host\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390604    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-run-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390693    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-sys-fs\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.390918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391009    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-tmp-dir\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391099    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391163    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-etc-openvswitch\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-kubelet-config\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-run\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391364    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-config\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.392170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-systemd-units\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.391469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.391556    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392044    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-ovnkube-script-lib\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.389108    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-system-cni-dir\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.392093    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:07.892073768 +0000 UTC m=+3.004616342 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-registration-dir\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392390    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-ovn\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392413    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-sysctl-conf\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-node-log\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392503    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-hosts-file\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-modprobe-d\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c9d76e05-0fda-4a65-a3de-c656941e5799-dbus\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e1d07af1-19e5-40ac-9fed-97b43510b195-cnibin\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-run-systemd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392843    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.393076 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.392925    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5223a0b4-ae1e-4100-9573-48ed5f55f20e-serviceca\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.395297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.393232    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2bd52190-ca3b-4aff-a812-e11908b5b960-env-overrides\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.395297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.393291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2bd52190-ca3b-4aff-a812-e11908b5b960-host-cni-bin\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.395297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.393453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e1d07af1-19e5-40ac-9fed-97b43510b195-cni-binary-copy\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.395297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.394482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-etc-tuned\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.395701 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.395667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09e968f1-1e24-4c17-a260-81a7fb18e98e-tmp\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.397754 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.397471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2bd52190-ca3b-4aff-a812-e11908b5b960-ovn-node-metrics-cert\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.399823 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.399795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tjhl\" (UniqueName: \"kubernetes.io/projected/09e968f1-1e24-4c17-a260-81a7fb18e98e-kube-api-access-9tjhl\") pod \"tuned-hzzr5\" (UID: \"09e968f1-1e24-4c17-a260-81a7fb18e98e\") " pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.400732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.400707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62r6n\" (UniqueName: \"kubernetes.io/projected/77024620-0563-4b23-9fec-b1f43193e81e-kube-api-access-62r6n\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.400841 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.400824    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xd5j\" (UniqueName: \"kubernetes.io/projected/e1d07af1-19e5-40ac-9fed-97b43510b195-kube-api-access-5xd5j\") pod \"multus-additional-cni-plugins-gk7df\" (UID: \"e1d07af1-19e5-40ac-9fed-97b43510b195\") " pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.403861 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.403835    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:07.403950 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.403879    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:07.403950 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.403894    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:07.404054 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.403955    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:07.903937159 +0000 UTC m=+3.016479732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:07.407442 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.407415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prrhd\" (UniqueName: \"kubernetes.io/projected/2bd52190-ca3b-4aff-a812-e11908b5b960-kube-api-access-prrhd\") pod \"ovnkube-node-mjwb8\" (UID: \"2bd52190-ca3b-4aff-a812-e11908b5b960\") " pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.413887 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.413858    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8ctg\" (UniqueName: \"kubernetes.io/projected/2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5-kube-api-access-j8ctg\") pod \"aws-ebs-csi-driver-node-7c6c5\" (UID: \"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.414016 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.413854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8cd8\" (UniqueName: \"kubernetes.io/projected/5223a0b4-ae1e-4100-9573-48ed5f55f20e-kube-api-access-n8cd8\") pod \"node-ca-m7vf9\" (UID: \"5223a0b4-ae1e-4100-9573-48ed5f55f20e\") " pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.416829 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.416794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn66\" (UniqueName: \"kubernetes.io/projected/0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0-kube-api-access-7dn66\") pod \"node-resolver-mk9jg\" (UID: \"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0\") " pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.420741 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.420685    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal" event={"ID":"5784c315c79fb4bd1f99b0628dd3ba86","Type":"ContainerStarted","Data":"e8c015b54051dc7d2718a3856ddb28d1caeea5ed745b1d2b778a4bf50685523f"}
Jul 17 16:26:07.423514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.423483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal" event={"ID":"49e085301fad9f39888ed44453973a3b","Type":"ContainerStarted","Data":"44e2e00c0d03b2937dd4ba498e1aeb31d24d185abe11f3e3b4e3b76e1ce79199"}
Jul 17 16:26:07.491162 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491048    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-system-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491162 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491100    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-cni-binary-copy\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491162 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491128    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c40893da-a551-4fc7-8762-0efb79720932-iptables-alerter-script\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491177    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40893da-a551-4fc7-8762-0efb79720932-host-slash\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491229    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491253    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-netns\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-bin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491301    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4k2x\" (UniqueName: \"kubernetes.io/projected/4a4e786f-0764-4b3b-82f2-d709a8217c89-kube-api-access-c4k2x\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-daemon-config\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491380    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-multus-certs\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491407    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-k8s-cni-cncf-io\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491431    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-kubelet\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-os-release\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491482    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-socket-dir-parent\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491506    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmxh\" (UniqueName: \"kubernetes.io/projected/c40893da-a551-4fc7-8762-0efb79720932-kube-api-access-8mmxh\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ff89ab6-7072-4bbc-a35b-d393540dfc67-konnectivity-ca\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491571    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-conf-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491597    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-hostroot\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ff89ab6-7072-4bbc-a35b-d393540dfc67-agent-certs\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491658    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-cnibin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-multus\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491707    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-etc-kubernetes\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-etc-kubernetes\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.491940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.491881    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-system-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492445 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492003    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-kubelet\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492521 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492495    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c40893da-a551-4fc7-8762-0efb79720932-iptables-alerter-script\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.492521 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492520    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-cni-binary-copy\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492548    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c40893da-a551-4fc7-8762-0efb79720932-host-slash\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492590    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-cni-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492601    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-os-release\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492615    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-netns\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492642    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-bin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.492672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.492650    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-socket-dir-parent\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493122 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-daemon-config\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493149    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-multus-certs\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493230 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493175    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-run-k8s-cni-cncf-io\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493338 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493309    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2ff89ab6-7072-4bbc-a35b-d393540dfc67-konnectivity-ca\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.493432 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493376    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-multus-conf-dir\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493432 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493410    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-hostroot\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493821 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-cnibin\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.493899 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.493818    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4a4e786f-0764-4b3b-82f2-d709a8217c89-host-var-lib-cni-multus\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.496050 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.496028    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2ff89ab6-7072-4bbc-a35b-d393540dfc67-agent-certs\") pod \"konnectivity-agent-zt999\" (UID: \"2ff89ab6-7072-4bbc-a35b-d393540dfc67\") " pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.504101 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.504067    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmxh\" (UniqueName: \"kubernetes.io/projected/c40893da-a551-4fc7-8762-0efb79720932-kube-api-access-8mmxh\") pod \"iptables-alerter-ccwcd\" (UID: \"c40893da-a551-4fc7-8762-0efb79720932\") " pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.504684 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.504658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4k2x\" (UniqueName: \"kubernetes.io/projected/4a4e786f-0764-4b3b-82f2-d709a8217c89-kube-api-access-c4k2x\") pod \"multus-dhxdq\" (UID: \"4a4e786f-0764-4b3b-82f2-d709a8217c89\") " pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.578334 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.578294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5"
Jul 17 16:26:07.586985 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.586957    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hzzr5"
Jul 17 16:26:07.597480 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.597455    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gk7df"
Jul 17 16:26:07.605328 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.605298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m7vf9"
Jul 17 16:26:07.615468 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.615436    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:07.623633 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.623610    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mk9jg"
Jul 17 16:26:07.631614 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.631591    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhxdq"
Jul 17 16:26:07.651791 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.651749    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:07.662965 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.662926    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ccwcd"
Jul 17 16:26:07.895447 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.895405    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:07.895653 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.895471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:07.895653 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.895596    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:07.895653 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.895599    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:07.895784 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.895671    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:08.895648566 +0000 UTC m=+4.008191128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:07.895784 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.895691    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:08.895680348 +0000 UTC m=+4.008222904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:07.995947 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:07.995910    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:07.996155 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.996112    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:07.996155 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.996147    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:07.996249 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.996164    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:07.996249 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:07.996230    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:08.996213519 +0000 UTC m=+4.108756078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:08.322545 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:08.322497    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 16:21:07 +0000 UTC" deadline="2028-03-30 02:29:21.9115653 +0000 UTC"
Jul 17 16:26:08.322545 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:08.322541    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14914h3m13.58902902s"
Jul 17 16:26:08.408510 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:08.408469    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:08.408694 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:08.408601    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:08.658997 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:08.658758    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1d07af1_19e5_40ac_9fed_97b43510b195.slice/crio-5894947d2d2f7c923ef5416f4498c40325bd8c5cd2e4a5ca4fb527d47df9e378 WatchSource:0}: Error finding container 5894947d2d2f7c923ef5416f4498c40325bd8c5cd2e4a5ca4fb527d47df9e378: Status 404 returned error can't find the container with id 5894947d2d2f7c923ef5416f4498c40325bd8c5cd2e4a5ca4fb527d47df9e378
Jul 17 16:26:08.659876 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:08.659842    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0b62b7_29e1_4c9d_b280_2ef10db4a5a5.slice/crio-ed62bb58d6725653c10c4c66557460d90f92464e87aceb4047c89deb325d7356 WatchSource:0}: Error finding container ed62bb58d6725653c10c4c66557460d90f92464e87aceb4047c89deb325d7356: Status 404 returned error can't find the container with id ed62bb58d6725653c10c4c66557460d90f92464e87aceb4047c89deb325d7356
Jul 17 16:26:08.660731 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:08.660651    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff89ab6_7072_4bbc_a35b_d393540dfc67.slice/crio-147d57bc4570e3f79dfe1cf9b077f4ab40852f2a9ac4b2f4c456287774662c92 WatchSource:0}: Error finding container 147d57bc4570e3f79dfe1cf9b077f4ab40852f2a9ac4b2f4c456287774662c92: Status 404 returned error can't find the container with id 147d57bc4570e3f79dfe1cf9b077f4ab40852f2a9ac4b2f4c456287774662c92
Jul 17 16:26:08.663688 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:08.663633    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4e786f_0764_4b3b_82f2_d709a8217c89.slice/crio-072d7396f4f2e45891e09d34c0b537c3054daaaffdb1fe9f39ffcc070ad43f4e WatchSource:0}: Error finding container 072d7396f4f2e45891e09d34c0b537c3054daaaffdb1fe9f39ffcc070ad43f4e: Status 404 returned error can't find the container with id 072d7396f4f2e45891e09d34c0b537c3054daaaffdb1fe9f39ffcc070ad43f4e
Jul 17 16:26:08.666139 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:08.665529    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd52190_ca3b_4aff_a812_e11908b5b960.slice/crio-1e2614916022b76b3a73c6cb2da4bc50225757c8ec26a3e8dadc674747fd1543 WatchSource:0}: Error finding container 1e2614916022b76b3a73c6cb2da4bc50225757c8ec26a3e8dadc674747fd1543: Status 404 returned error can't find the container with id 1e2614916022b76b3a73c6cb2da4bc50225757c8ec26a3e8dadc674747fd1543
Jul 17 16:26:08.903324 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:08.903289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:08.903461 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:08.903342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:08.903461 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:08.903429    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:08.903461 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:08.903458    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:08.903586 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:08.903498    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:10.903481424 +0000 UTC m=+6.016023979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:08.903586 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:08.903513    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:10.903506052 +0000 UTC m=+6.016048606 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:09.004540 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.004503    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:09.004690 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.004669    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:09.004690 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.004689    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:09.004784 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.004698    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:09.004784 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.004753    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:11.004737693 +0000 UTC m=+6.117280249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:09.323705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.323638    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 16:21:07 +0000 UTC" deadline="2027-12-30 16:09:04.661023834 +0000 UTC"
Jul 17 16:26:09.323705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.323703    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12743h42m55.33732443s"
Jul 17 16:26:09.408440 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.408396    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:09.408617 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.408531    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:09.408952 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.408905    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:09.409092 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:09.409034    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:09.440788 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.440565    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal" event={"ID":"5784c315c79fb4bd1f99b0628dd3ba86","Type":"ContainerStarted","Data":"8cf71d00f33ea6cbcfba0ba25682d497766f2b081e5cb6de8b71ec9ea4202f5c"}
Jul 17 16:26:09.445068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.445030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7vf9" event={"ID":"5223a0b4-ae1e-4100-9573-48ed5f55f20e","Type":"ContainerStarted","Data":"8e695bd8b87cde2120d56f8abf69560013076bbe69adc27e68bd41306ee1be6d"}
Jul 17 16:26:09.451288 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.451249    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzzr5" event={"ID":"09e968f1-1e24-4c17-a260-81a7fb18e98e","Type":"ContainerStarted","Data":"cf773dd4146a491ccc7621641d33253794bed31fde2f9e1abb5dd9a9c59c7140"}
Jul 17 16:26:09.455473 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.455437    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccwcd" event={"ID":"c40893da-a551-4fc7-8762-0efb79720932","Type":"ContainerStarted","Data":"e02760c14a9ca3eba3db048a3915ab1935f3af3030a3d54a9dbfebea98253918"}
Jul 17 16:26:09.456223 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.456149    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-12.ec2.internal" podStartSLOduration=3.456114427 podStartE2EDuration="3.456114427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:09.455629996 +0000 UTC m=+4.568172586" watchObservedRunningTime="2026-07-17 16:26:09.456114427 +0000 UTC m=+4.568657004"
Jul 17 16:26:09.458630 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.458601    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"1e2614916022b76b3a73c6cb2da4bc50225757c8ec26a3e8dadc674747fd1543"}
Jul 17 16:26:09.466335 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.466298    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhxdq" event={"ID":"4a4e786f-0764-4b3b-82f2-d709a8217c89","Type":"ContainerStarted","Data":"072d7396f4f2e45891e09d34c0b537c3054daaaffdb1fe9f39ffcc070ad43f4e"}
Jul 17 16:26:09.472450 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.472414    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerStarted","Data":"5894947d2d2f7c923ef5416f4498c40325bd8c5cd2e4a5ca4fb527d47df9e378"}
Jul 17 16:26:09.487306 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.487268    2558 generic.go:356] "Generic (PLEG): container finished" podID="49e085301fad9f39888ed44453973a3b" containerID="a14be170d0ece1e71ab2a8406d44594bb3639f7c94ddb61058847a53e15df8fc" exitCode=0
Jul 17 16:26:09.487539 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.487512    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal" event={"ID":"49e085301fad9f39888ed44453973a3b","Type":"ContainerDied","Data":"a14be170d0ece1e71ab2a8406d44594bb3639f7c94ddb61058847a53e15df8fc"}
Jul 17 16:26:09.496866 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.496832    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mk9jg" event={"ID":"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0","Type":"ContainerStarted","Data":"f9cf87ca1e936edcac99205c6ec02652385075f4a216b081ee0300e7b4cad77e"}
Jul 17 16:26:09.520844 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.520805    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt999" event={"ID":"2ff89ab6-7072-4bbc-a35b-d393540dfc67","Type":"ContainerStarted","Data":"147d57bc4570e3f79dfe1cf9b077f4ab40852f2a9ac4b2f4c456287774662c92"}
Jul 17 16:26:09.524275 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:09.524234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5" event={"ID":"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5","Type":"ContainerStarted","Data":"ed62bb58d6725653c10c4c66557460d90f92464e87aceb4047c89deb325d7356"}
Jul 17 16:26:10.409090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:10.409057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:10.409587 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:10.409206    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:10.551726 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:10.551660    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal" event={"ID":"49e085301fad9f39888ed44453973a3b","Type":"ContainerStarted","Data":"fea6712fd4a8f6d26b93b42281dfd4640ea0f1672fde137bf2a3abfd2bf16f02"}
Jul 17 16:26:10.569376 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:10.569314    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-12.ec2.internal" podStartSLOduration=4.569289714 podStartE2EDuration="4.569289714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:10.568928273 +0000 UTC m=+5.681470849" watchObservedRunningTime="2026-07-17 16:26:10.569289714 +0000 UTC m=+5.681832293"
Jul 17 16:26:10.921170 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:10.921114    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:10.921390 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:10.921209    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:10.921390 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:10.921358    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:10.921540 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:10.921423    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:14.92140379 +0000 UTC m=+10.033946344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:10.921540 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:10.921480    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:10.921540 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:10.921522    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:14.921510004 +0000 UTC m=+10.034052562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:11.022548 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:11.022420    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:11.022755 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.022593    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:11.022755 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.022621    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:11.022755 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.022635    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:11.022755 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.022698    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:15.022677861 +0000 UTC m=+10.135220421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:11.408705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:11.408670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:11.408883 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.408815    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:11.409496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:11.409472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:11.417148 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:11.414373    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:12.409071 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:12.409039    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:12.409273 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:12.409201    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:13.409162 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:13.408599    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:13.409162 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:13.408748    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:13.409661 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:13.409198    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:13.409661 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:13.409297    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:14.408588 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:14.408552    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:14.408732 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:14.408694    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:14.957506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:14.957464    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:14.957961 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:14.957535    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:14.957961 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:14.957679    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:14.957961 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:14.957739    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:22.957719857 +0000 UTC m=+18.070262423 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:14.958114 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:14.958087    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:14.958177 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:14.958138    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:22.958113796 +0000 UTC m=+18.070656349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:15.058135 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:15.058092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:15.058327 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.058309    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:15.058408 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.058337    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:15.058408 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.058349    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:15.058408 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.058405    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:23.058386935 +0000 UTC m=+18.170929492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:15.409712 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:15.409677    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:15.409883 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.409812    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:15.409883 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:15.409855    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:15.409984 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:15.409960    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:16.408608 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:16.408570    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:16.409047 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:16.408714    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:17.411224 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:17.411192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:17.411679 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:17.411339    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:17.411736 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:17.411702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:17.411800 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:17.411783    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:18.408881 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:18.408844    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:18.409047 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:18.408985    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:19.408705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:19.408670    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:19.409167 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:19.408671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:19.409167 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:19.408828    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:19.409167 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:19.408892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:20.408954 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:20.408916    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:20.409379 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:20.409042    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:21.408532 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:21.408498    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:21.408734 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:21.408510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:21.408734 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:21.408643    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:21.408734 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:21.408674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:22.409012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:22.408969    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:22.409493 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:22.409097    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:23.019852 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:23.019816    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:23.020023 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:23.019889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:23.020023 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.019970    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:23.020097 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.020030    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:26:39.020014458 +0000 UTC m=+34.132557015 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:23.020097 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.019976    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:23.020248 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.020099    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:39.020088228 +0000 UTC m=+34.132630785 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:23.121025 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:23.120995    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:23.121151 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.121119    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:23.121188 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.121155    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:23.121188 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.121164    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:23.121253 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.121209    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:26:39.121197647 +0000 UTC m=+34.233740201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:23.409069 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:23.409031    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:23.409538 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:23.409034    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:23.409538 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.409188    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:23.409538 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:23.409262    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:24.409096 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:24.409060    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:24.409555 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:24.409200    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:25.409415 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:25.409376    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:25.409872 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:25.409496    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:25.409872 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:25.409553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:25.409872 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:25.409672    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:26.408756 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:26.408706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:26.409023 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:26.408837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:27.409012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:27.408974    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:27.409012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:27.409005    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:27.409680 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:27.409160    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:27.409680 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:27.409203    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:28.408629 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.408310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:28.408868 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:28.408713    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:28.589272 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.589165    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hzzr5" event={"ID":"09e968f1-1e24-4c17-a260-81a7fb18e98e","Type":"ContainerStarted","Data":"68b89de6e2e5437cba67781321b38b1556b6f6711b9a92c05d7af459617f34ff"}
Jul 17 16:26:28.591867 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.591837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:26:28.592312 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592283    2558 generic.go:356] "Generic (PLEG): container finished" podID="2bd52190-ca3b-4aff-a812-e11908b5b960" containerID="8f72d9aa41dd5e8d671ca79b0bf3fe7429229f7240d965ebf9e59b1c79a36244" exitCode=1
Jul 17 16:26:28.592409 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592348    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"1390b36f0209b8dcb509d9b06dcd9543531903d9fb66c5d7c593e0f315c50f1d"}
Jul 17 16:26:28.592466 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"d220c48a66d8b05297c3860fa44b7f6135b107732b9c7b426b97b1ffad6db419"}
Jul 17 16:26:28.592523 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592470    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"69c5728583acb64d4ad57df94f70c3af75c31af318d6d6947d9ed7d9e4195ddc"}
Jul 17 16:26:28.592523 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerDied","Data":"8f72d9aa41dd5e8d671ca79b0bf3fe7429229f7240d965ebf9e59b1c79a36244"}
Jul 17 16:26:28.592617 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.592562    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"119d026eb16f71a964b4f8102ac8f6b54b586bffa08275aa69295d50ea7b865e"}
Jul 17 16:26:28.593981 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.593956    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhxdq" event={"ID":"4a4e786f-0764-4b3b-82f2-d709a8217c89","Type":"ContainerStarted","Data":"3cb39f07e12c3abaf984cad717c24073fc73d1aae9b00e4ff5d805ac5bdc300c"}
Jul 17 16:26:28.595588 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.595562    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="042d37cb97fd95d76a12ee209c7c2454c72676ddfb123d139078ce169a162ecc" exitCode=0
Jul 17 16:26:28.595704 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.595645    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"042d37cb97fd95d76a12ee209c7c2454c72676ddfb123d139078ce169a162ecc"}
Jul 17 16:26:28.599833 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.599754    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mk9jg" event={"ID":"0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0","Type":"ContainerStarted","Data":"092eaf7476f728234ccc70c4bc75e8683c4b34b465e13b753055799f3d651fd4"}
Jul 17 16:26:28.601406 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.601377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zt999" event={"ID":"2ff89ab6-7072-4bbc-a35b-d393540dfc67","Type":"ContainerStarted","Data":"450d804005adb27b2db78524f0b192c7e07aeda6663d3db10af593b9bd0b7c93"}
Jul 17 16:26:28.602788 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.602765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5" event={"ID":"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5","Type":"ContainerStarted","Data":"3f9fa4899104176e7f1eef2568a472198e9db72f991e9e76e97fe9a780b4b882"}
Jul 17 16:26:28.604040 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.604020    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m7vf9" event={"ID":"5223a0b4-ae1e-4100-9573-48ed5f55f20e","Type":"ContainerStarted","Data":"6f04ba7323871e9b00f7e3bf13525a3feeffbb18375907be72a9e8a793e54f3f"}
Jul 17 16:26:28.608868 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.608830    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hzzr5" podStartSLOduration=4.72495042 podStartE2EDuration="23.608818262s" totalImagesPullingTime="18.883867842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:28.608469618 +0000 UTC m=+23.721012206" watchObservedRunningTime="2026-07-17 16:26:28.608818262 +0000 UTC m=+23.721360887"
Jul 17 16:26:28.651550 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.651506    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dhxdq" podStartSLOduration=4.732721196 podStartE2EDuration="23.65148876s" totalImagesPullingTime="18.918767564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:28.65088264 +0000 UTC m=+23.763425216" watchObservedRunningTime="2026-07-17 16:26:28.65148876 +0000 UTC m=+23.764031335"
Jul 17 16:26:28.667154 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.667091    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mk9jg" podStartSLOduration=4.773247361 podStartE2EDuration="23.66707633s" totalImagesPullingTime="18.893828969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:28.66650918 +0000 UTC m=+23.779051755" watchObservedRunningTime="2026-07-17 16:26:28.66707633 +0000 UTC m=+23.779618906"
Jul 17 16:26:28.685299 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.685249    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zt999" podStartSLOduration=4.841342546 podStartE2EDuration="23.685233547s" totalImagesPullingTime="18.843891001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:28.684804876 +0000 UTC m=+23.797347451" watchObservedRunningTime="2026-07-17 16:26:28.685233547 +0000 UTC m=+23.797776123"
Jul 17 16:26:28.972887 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:28.972864    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 16:26:29.341826 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.341732    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T16:26:28.972883467Z","UUID":"8779ed8d-6d72-44a0-a9c1-f4fe4205e6d5","Handler":null,"Name":"","Endpoint":""}
Jul 17 16:26:29.343382 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.343363    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 16:26:29.343506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.343405    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 16:26:29.408864 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.408829    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:29.409035 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.408829    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:29.409035 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:29.408970    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:29.409035 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:29.409004    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:29.608392 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.608307    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ccwcd" event={"ID":"c40893da-a551-4fc7-8762-0efb79720932","Type":"ContainerStarted","Data":"b6ae4aca84a1f59196cc5fe660769a02e0d61d58be124e00c96e684f6b34fbfd"}
Jul 17 16:26:29.611631 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.611602    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:26:29.612148 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.612107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"937be1105f09cd4f4b7ef6ce2717f7cdaf15c5f38dc5cf5b0de0c72d5a4570d4"}
Jul 17 16:26:29.614163 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.614114    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5" event={"ID":"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5","Type":"ContainerStarted","Data":"98313e7dd2c933dbe4e33a4bea93867be52365e45e6d5b11e9ee1dc0c71afc09"}
Jul 17 16:26:29.639800 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:29.639750    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m7vf9" podStartSLOduration=5.758537809 podStartE2EDuration="24.639731802s" totalImagesPullingTime="18.881193993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:28.703995347 +0000 UTC m=+23.816537922" watchObservedRunningTime="2026-07-17 16:26:29.639731802 +0000 UTC m=+24.752274395"
Jul 17 16:26:30.408159 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:30.408112    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:30.408388 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:30.408263    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:31.076798 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.076458    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:31.077260 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.077144    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:31.090849 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.090805    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ccwcd" podStartSLOduration=7.221362193 podStartE2EDuration="26.090789643s" totalImagesPullingTime="18.86942745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:29.640380081 +0000 UTC m=+24.752922657" watchObservedRunningTime="2026-07-17 16:26:31.090789643 +0000 UTC m=+26.203332220"
Jul 17 16:26:31.408390 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.408357    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:31.408552 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:31.408509    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:31.408838 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.408820    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:31.408973 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:31.408889    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:31.620664 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.620625    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5" event={"ID":"2d0b62b7-29e1-4c9d-b280-2ef10db4a5a5","Type":"ContainerStarted","Data":"f84f4b13bab85750b72817926df040fde5097d9103901e5a5f71704baaf6c4c9"}
Jul 17 16:26:31.624061 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.624033    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:26:31.624482 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.624456    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"5225762b9f40c7833c2ec41831816f89e23e2a20e28b67ad510a4dba1efb7dbe"}
Jul 17 16:26:31.640028 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:31.639963    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7c6c5" podStartSLOduration=4.950217668 podStartE2EDuration="26.639940245s" totalImagesPullingTime="21.689722577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:31.639440011 +0000 UTC m=+26.751982588" watchObservedRunningTime="2026-07-17 16:26:31.639940245 +0000 UTC m=+26.752482822"
Jul 17 16:26:32.408795 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:32.408755    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:32.409328 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:32.408895    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:33.408516 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.408487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:33.408516 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.408511    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:33.408664 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:33.408636    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:33.409482 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:33.408739    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:33.631817 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.631574    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:26:33.632142 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.632103    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"a1a3ab8e1ad4d3097924f25934c42dac8be2f872746a38bf8641e63784c2d3f4"}
Jul 17 16:26:33.632347 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.632320    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:33.632455 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.632404    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:33.632613 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.632596    2558 scope.go:117] "RemoveContainer" containerID="8f72d9aa41dd5e8d671ca79b0bf3fe7429229f7240d965ebf9e59b1c79a36244"
Jul 17 16:26:33.649358 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:33.649321    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:34.088239 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.088200    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:34.088444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.088340    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 17 16:26:34.088858 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.088840    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zt999"
Jul 17 16:26:34.408427 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.408393    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:34.408568 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:34.408497    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:34.642971 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.642883    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:26:34.643407 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.643376    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" event={"ID":"2bd52190-ca3b-4aff-a812-e11908b5b960","Type":"ContainerStarted","Data":"67c2dcbd79eddf717670d681c23cd3def38e476978cf070fe9ee6ddd86d50211"}
Jul 17 16:26:34.643603 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.643578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:34.646368 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.646336    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="96d2d6ea0ad5b9b05c2cde2f6442528efd0da1ac0e4a8214aa29fb044f3a87c8" exitCode=0
Jul 17 16:26:34.646512 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.646420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"96d2d6ea0ad5b9b05c2cde2f6442528efd0da1ac0e4a8214aa29fb044f3a87c8"}
Jul 17 16:26:34.663491 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.663457    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:26:34.674379 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:34.674333    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8" podStartSLOduration=10.458402506 podStartE2EDuration="29.674315451s" totalImagesPullingTime="19.215912945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:34.674163687 +0000 UTC m=+29.786706261" watchObservedRunningTime="2026-07-17 16:26:34.674315451 +0000 UTC m=+29.786858036"
Jul 17 16:26:35.409818 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.409785    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:35.409988 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:35.409921    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:35.409988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.409964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:35.410105 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:35.410082    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:35.650825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.650578    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerStarted","Data":"9d8ec09cb1fa16390f1cdb5946f77475a639d8bbdaf6a007cb8910444a9e0eb2"}
Jul 17 16:26:35.671739 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.671645    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqmvb"]
Jul 17 16:26:35.671889 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.671792    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:35.671948 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:35.671920    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:35.672088 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.672064    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwxbx"]
Jul 17 16:26:35.672189 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.672175    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:35.672333 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:35.672274    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:35.672669 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.672648    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5vch"]
Jul 17 16:26:35.672773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:35.672729    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:35.672848 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:35.672827    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:36.654766 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:36.654731    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="9d8ec09cb1fa16390f1cdb5946f77475a639d8bbdaf6a007cb8910444a9e0eb2" exitCode=0
Jul 17 16:26:36.655365 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:36.654825    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"9d8ec09cb1fa16390f1cdb5946f77475a639d8bbdaf6a007cb8910444a9e0eb2"}
Jul 17 16:26:37.411967 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:37.411940    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:37.412157 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:37.412057    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:37.412157 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:37.412066    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:37.412157 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:37.412088    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:37.412324 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:37.412182    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:37.412324 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:37.412263    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:37.660002 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:37.659965    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="1f4f000210125ab4dfe521ac4829a07c5c1ad9991836202529c8d612614cea4e" exitCode=0
Jul 17 16:26:37.660562 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:37.660005    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"1f4f000210125ab4dfe521ac4829a07c5c1ad9991836202529c8d612614cea4e"}
Jul 17 16:26:39.034259 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.034226    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:39.034821 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.034290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:39.034821 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.034390    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:39.034821 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.034395    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:39.034821 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.034450    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret podName:c9d76e05-0fda-4a65-a3de-c656941e5799 nodeName:}" failed. No retries permitted until 2026-07-17 16:27:11.034434287 +0000 UTC m=+66.146976841 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret") pod "global-pull-secret-syncer-cqmvb" (UID: "c9d76e05-0fda-4a65-a3de-c656941e5799") : object "kube-system"/"original-pull-secret" not registered
Jul 17 16:26:39.034821 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.034466    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs podName:77024620-0563-4b23-9fec-b1f43193e81e nodeName:}" failed. No retries permitted until 2026-07-17 16:27:11.034456911 +0000 UTC m=+66.146999464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs") pod "network-metrics-daemon-d5vch" (UID: "77024620-0563-4b23-9fec-b1f43193e81e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 16:26:39.135026 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.134987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:39.135246 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.135210    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 16:26:39.135246 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.135237    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 16:26:39.135353 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.135250    2558 projected.go:196] Error preparing data for projected volume kube-api-access-dq8tj for pod openshift-network-diagnostics/network-check-target-kwxbx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:39.135353 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.135320    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj podName:c3a3a52a-aff9-4194-a960-4ebae9b31ba5 nodeName:}" failed. No retries permitted until 2026-07-17 16:27:11.135300712 +0000 UTC m=+66.247843278 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq8tj" (UniqueName: "kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj") pod "network-check-target-kwxbx" (UID: "c3a3a52a-aff9-4194-a960-4ebae9b31ba5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 16:26:39.409175 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.409139    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:39.409356 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.409196    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:39.409356 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:39.409142    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:39.409356 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.409280    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:39.409485 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.409421    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:39.409526 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:39.409514    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:40.907084 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:40.907056    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mk9jg_0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0/dns-node-resolver/0.log"
Jul 17 16:26:41.408740 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.408705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:41.408909 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.408853    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d5vch" podUID="77024620-0563-4b23-9fec-b1f43193e81e"
Jul 17 16:26:41.409054 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.409038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:41.409150 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.409115    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kwxbx" podUID="c3a3a52a-aff9-4194-a960-4ebae9b31ba5"
Jul 17 16:26:41.409383 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.409362    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:41.409463 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.409444    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-cqmvb" podUID="c9d76e05-0fda-4a65-a3de-c656941e5799"
Jul 17 16:26:41.690716 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.690682    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-12.ec2.internal" event="NodeReady"
Jul 17 16:26:41.690898 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.690845    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 16:26:41.743236 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.743199    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gv9nc"]
Jul 17 16:26:41.746042 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.746016    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xf2nt"]
Jul 17 16:26:41.746224 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.746168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.750630 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.750588    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 16:26:41.750784 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.750693    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 16:26:41.750878 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.750839    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4x2wh\""
Jul 17 16:26:41.750932 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.750909    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.753510 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.753491    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j87cv\""
Jul 17 16:26:41.753795 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.753776    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 16:26:41.754086 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.754068    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 16:26:41.754187 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.754140    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 16:26:41.758094 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.758069    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xf2nt"]
Jul 17 16:26:41.763024 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.763002    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gv9nc"]
Jul 17 16:26:41.773024 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.772990    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dw6d9"]
Jul 17 16:26:41.775150 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.775113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.778492 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.778473    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 16:26:41.778740 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.778717    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 16:26:41.778880 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.778810    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 16:26:41.779106 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.779090    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 16:26:41.779452 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.779436    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxh6h\""
Jul 17 16:26:41.788192 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.788166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dw6d9"]
Jul 17 16:26:41.855724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800d8648-76c4-496d-80b6-ede3a10dceaf-crio-socket\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.855927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.855927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855789    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-config-volume\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.855927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855808    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h4vt\" (UniqueName: \"kubernetes.io/projected/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-kube-api-access-9h4vt\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.855927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d8648-76c4-496d-80b6-ede3a10dceaf-data-volume\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.856156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.855936    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szpnq\" (UniqueName: \"kubernetes.io/projected/c77d63b4-d290-4121-b00b-1caaf25d0346-kube-api-access-szpnq\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.856156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.856011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.856156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.856038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.856156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.856077    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-tmp-dir\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.856156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.856097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gvx\" (UniqueName: \"kubernetes.io/projected/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-api-access-85gvx\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.856356 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.856184    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c77d63b4-d290-4121-b00b-1caaf25d0346-cert\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.957068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.956986    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800d8648-76c4-496d-80b6-ede3a10dceaf-crio-socket\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957023    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.957068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-config-volume\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.957068 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h4vt\" (UniqueName: \"kubernetes.io/projected/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-kube-api-access-9h4vt\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d8648-76c4-496d-80b6-ede3a10dceaf-data-volume\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szpnq\" (UniqueName: \"kubernetes.io/projected/c77d63b4-d290-4121-b00b-1caaf25d0346-kube-api-access-szpnq\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957208    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957284    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls podName:3ee71457-9c7d-41f1-bb86-3c69f0f160fe nodeName:}" failed. No retries permitted until 2026-07-17 16:26:42.457262256 +0000 UTC m=+37.569804811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls") pod "dns-default-gv9nc" (UID: "3ee71457-9c7d-41f1-bb86-3c69f0f160fe") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957318    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/800d8648-76c4-496d-80b6-ede3a10dceaf-crio-socket\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957217    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957471    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:42.45745805 +0000 UTC m=+37.570000611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/800d8648-76c4-496d-80b6-ede3a10dceaf-data-volume\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957492    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957548    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957551    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-tmp-dir\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957567    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85gvx\" (UniqueName: \"kubernetes.io/projected/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-api-access-85gvx\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:41.957595    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:42.457583148 +0000 UTC m=+37.570125702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957623    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c77d63b4-d290-4121-b00b-1caaf25d0346-cert\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.957703 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-config-volume\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.958372 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.957863    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-tmp-dir\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:41.962578 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.962553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c77d63b4-d290-4121-b00b-1caaf25d0346-cert\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.972735 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.972501    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szpnq\" (UniqueName: \"kubernetes.io/projected/c77d63b4-d290-4121-b00b-1caaf25d0346-kube-api-access-szpnq\") pod \"ingress-canary-xf2nt\" (UID: \"c77d63b4-d290-4121-b00b-1caaf25d0346\") " pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:41.973324 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.973297    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gvx\" (UniqueName: \"kubernetes.io/projected/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-api-access-85gvx\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:41.973890 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:41.973865    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h4vt\" (UniqueName: \"kubernetes.io/projected/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-kube-api-access-9h4vt\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:42.069115 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.069075    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xf2nt"
Jul 17 16:26:42.080377 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.080354    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7vf9_5223a0b4-ae1e-4100-9573-48ed5f55f20e/node-ca/0.log"
Jul 17 16:26:42.219979 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.219953    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xf2nt"]
Jul 17 16:26:42.224355 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:42.224322    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc77d63b4_d290_4121_b00b_1caaf25d0346.slice/crio-5f3ca01bafd073685d300e8ab6f8d432f400f66c2b1b9a03f335b0e33a716578 WatchSource:0}: Error finding container 5f3ca01bafd073685d300e8ab6f8d432f400f66c2b1b9a03f335b0e33a716578: Status 404 returned error can't find the container with id 5f3ca01bafd073685d300e8ab6f8d432f400f66c2b1b9a03f335b0e33a716578
Jul 17 16:26:42.462111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.462071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:42.462111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.462113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:42.462330 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462219    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:42.462330 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462285    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.462267097 +0000 UTC m=+38.574809651 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:42.462330 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462314    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:42.462430 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462364    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.462346335 +0000 UTC m=+38.574888890 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:42.462430 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.462416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:42.462521 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462509    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:42.462557 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:42.462546    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls podName:3ee71457-9c7d-41f1-bb86-3c69f0f160fe nodeName:}" failed. No retries permitted until 2026-07-17 16:26:43.462534517 +0000 UTC m=+38.575077072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls") pod "dns-default-gv9nc" (UID: "3ee71457-9c7d-41f1-bb86-3c69f0f160fe") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:42.675023 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.674986    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="d495aa6ad3964a94b530d4337e1ceed01b47fb95754935d34436fb87cf138643" exitCode=0
Jul 17 16:26:42.675207 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.675067    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"d495aa6ad3964a94b530d4337e1ceed01b47fb95754935d34436fb87cf138643"}
Jul 17 16:26:42.676191 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:42.676172    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xf2nt" event={"ID":"c77d63b4-d290-4121-b00b-1caaf25d0346","Type":"ContainerStarted","Data":"5f3ca01bafd073685d300e8ab6f8d432f400f66c2b1b9a03f335b0e33a716578"}
Jul 17 16:26:43.408835 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.408797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:26:43.409328 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.408797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:26:43.409328 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.409010    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:26:43.411654 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.411628    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 16:26:43.411789 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.411709    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7wh7\""
Jul 17 16:26:43.411889 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.411873    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 16:26:43.412098 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.412079    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 16:26:43.412410 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.412384    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 16:26:43.412537 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.412384    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54g7g\""
Jul 17 16:26:43.469337 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.469296    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:43.469535 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.469379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:43.469535 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.469408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:43.469535 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469476    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:43.469535 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469497    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:43.469535 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469516    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:43.469786 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469585    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls podName:3ee71457-9c7d-41f1-bb86-3c69f0f160fe nodeName:}" failed. No retries permitted until 2026-07-17 16:26:45.469553529 +0000 UTC m=+40.582096292 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls") pod "dns-default-gv9nc" (UID: "3ee71457-9c7d-41f1-bb86-3c69f0f160fe") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:43.469786 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469609    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:45.46960049 +0000 UTC m=+40.582143048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:43.469786 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:43.469624    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:45.469616187 +0000 UTC m=+40.582158741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:43.682730 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.682418    2558 generic.go:356] "Generic (PLEG): container finished" podID="e1d07af1-19e5-40ac-9fed-97b43510b195" containerID="a3e03fff805500b6ac6fb2ea41ca9085b545967dcab189629a51d76508140eb7" exitCode=0
Jul 17 16:26:43.682730 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:43.682450    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerDied","Data":"a3e03fff805500b6ac6fb2ea41ca9085b545967dcab189629a51d76508140eb7"}
Jul 17 16:26:44.687996 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:44.687954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gk7df" event={"ID":"e1d07af1-19e5-40ac-9fed-97b43510b195","Type":"ContainerStarted","Data":"9925b8461addb6f0d69be625e0202835d35adc5056e07e72a43d481cc55c93fb"}
Jul 17 16:26:44.724517 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:44.724471    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gk7df" podStartSLOduration=9.629607632999999 podStartE2EDuration="39.724456037s" totalImagesPullingTime="30.094848404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:44.711410111 +0000 UTC m=+39.823952713" watchObservedRunningTime="2026-07-17 16:26:44.724456037 +0000 UTC m=+39.836998654"
Jul 17 16:26:45.485723 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:45.485664    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:45.485911 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:45.485769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:45.485911 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:45.485798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:45.485911 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.485832    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:45.485911 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.485892    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 16:26:45.486080 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.485899    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls podName:3ee71457-9c7d-41f1-bb86-3c69f0f160fe nodeName:}" failed. No retries permitted until 2026-07-17 16:26:49.485880749 +0000 UTC m=+44.598423308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls") pod "dns-default-gv9nc" (UID: "3ee71457-9c7d-41f1-bb86-3c69f0f160fe") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:45.486080 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.485930    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:45.486221 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.485973    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:49.4859473 +0000 UTC m=+44.598489867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : configmap "kube-rbac-proxy" not found
Jul 17 16:26:45.486321 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:45.486305    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:49.486288395 +0000 UTC m=+44.598830951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:45.691704 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:45.691669    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xf2nt" event={"ID":"c77d63b4-d290-4121-b00b-1caaf25d0346","Type":"ContainerStarted","Data":"49fe7c2fdfd640b28c9ca47ad2bffa643c30db85faeb2c363ae83566999fd815"}
Jul 17 16:26:45.720218 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:45.720164    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xf2nt" podStartSLOduration=2.240713129 podStartE2EDuration="4.720148327s" totalImagesPullingTime="2.479435198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:26:45.719168676 +0000 UTC m=+40.831711266" watchObservedRunningTime="2026-07-17 16:26:45.720148327 +0000 UTC m=+40.832690903"
Jul 17 16:26:49.515988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:49.515952    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:49.516008    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:49.516102    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:49.516179    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls podName:3ee71457-9c7d-41f1-bb86-3c69f0f160fe nodeName:}" failed. No retries permitted until 2026-07-17 16:26:57.516164584 +0000 UTC m=+52.628707137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls") pod "dns-default-gv9nc" (UID: "3ee71457-9c7d-41f1-bb86-3c69f0f160fe") : secret "dns-default-metrics-tls" not found
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:49.516170    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:49.516280    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:49.516472 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:26:49.516347    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls podName:800d8648-76c4-496d-80b6-ede3a10dceaf nodeName:}" failed. No retries permitted until 2026-07-17 16:26:57.516331569 +0000 UTC m=+52.628874124 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dw6d9" (UID: "800d8648-76c4-496d-80b6-ede3a10dceaf") : secret "insights-runtime-extractor-tls" not found
Jul 17 16:26:49.516668 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:49.516551    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/800d8648-76c4-496d-80b6-ede3a10dceaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:57.577695 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.577651    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:57.578360 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.577734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:57.581517 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.581484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/800d8648-76c4-496d-80b6-ede3a10dceaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dw6d9\" (UID: \"800d8648-76c4-496d-80b6-ede3a10dceaf\") " pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:57.581517 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.581511    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3ee71457-9c7d-41f1-bb86-3c69f0f160fe-metrics-tls\") pod \"dns-default-gv9nc\" (UID: \"3ee71457-9c7d-41f1-bb86-3c69f0f160fe\") " pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:57.660172 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.660113    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:26:57.685403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.685372    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dw6d9"
Jul 17 16:26:57.829620 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.829536    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gv9nc"]
Jul 17 16:26:57.843963 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:57.843935    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dw6d9"]
Jul 17 16:26:57.846842 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:26:57.846815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod800d8648_76c4_496d_80b6_ede3a10dceaf.slice/crio-5cad7b002f7e16c5f43a292edde6c3b2ea7eabf48cc0db54d878fb682e1c3fdf WatchSource:0}: Error finding container 5cad7b002f7e16c5f43a292edde6c3b2ea7eabf48cc0db54d878fb682e1c3fdf: Status 404 returned error can't find the container with id 5cad7b002f7e16c5f43a292edde6c3b2ea7eabf48cc0db54d878fb682e1c3fdf
Jul 17 16:26:58.725886 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:58.725793    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9nc" event={"ID":"3ee71457-9c7d-41f1-bb86-3c69f0f160fe","Type":"ContainerStarted","Data":"db69d786f1d569d12ee974dffc70eecae267f5b0cb4acb1b135f9826f7360c9f"}
Jul 17 16:26:58.727725 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:26:58.727639    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dw6d9" event={"ID":"800d8648-76c4-496d-80b6-ede3a10dceaf","Type":"ContainerStarted","Data":"5cad7b002f7e16c5f43a292edde6c3b2ea7eabf48cc0db54d878fb682e1c3fdf"}
Jul 17 16:27:00.735433 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:00.735395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9nc" event={"ID":"3ee71457-9c7d-41f1-bb86-3c69f0f160fe","Type":"ContainerStarted","Data":"964594f1fc8ca35ced7f75eea8187d0953bdb2f72d74fc79c3390a098fbc4b06"}
Jul 17 16:27:00.735908 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:00.735462    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gv9nc" event={"ID":"3ee71457-9c7d-41f1-bb86-3c69f0f160fe","Type":"ContainerStarted","Data":"e1dc531cbcc07a236acc6689c360ec35d28356c62563631c970f066ce43c2a47"}
Jul 17 16:27:00.735908 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:00.735700    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:27:00.752662 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:00.752605    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gv9nc" podStartSLOduration=17.553115465 podStartE2EDuration="19.752580496s" totalImagesPullingTime="2.199465031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:00.751321024 +0000 UTC m=+55.863863601" watchObservedRunningTime="2026-07-17 16:27:00.752580496 +0000 UTC m=+55.865123089"
Jul 17 16:27:03.745434 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:03.745395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dw6d9" event={"ID":"800d8648-76c4-496d-80b6-ede3a10dceaf","Type":"ContainerStarted","Data":"1f3ec3fec868135d99f6819c564f188c41968614f8f600ac90fed0b13972faf4"}
Jul 17 16:27:04.921903 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.921862    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"]
Jul 17 16:27:04.923541 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.923517    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"]
Jul 17 16:27:04.923669 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.923651    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:04.925605 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.925584    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:04.926038 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.926019    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p9jsh\""
Jul 17 16:27:04.926263 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.926250    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 16:27:04.926915 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.926901    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 16:27:04.926959 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.926917    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 16:27:04.927007 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.926989    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 16:27:04.927870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.927855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 16:27:04.928022 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.928011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 16:27:04.928474 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.928456    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 16:27:04.928740 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.928725    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 16:27:04.940204 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.940179    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"]
Jul 17 16:27:04.945879 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:04.945850    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"]
Jul 17 16:27:05.034304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034265    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034319    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gnsb\" (UniqueName: \"kubernetes.io/projected/ab6a7f45-f614-4db6-9121-b0b5ae4382be-kube-api-access-2gnsb\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2g2v9\" (UniqueName: \"kubernetes.io/projected/2771476c-7666-4b91-a186-f6007c64a591-kube-api-access-2g2v9\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab6a7f45-f614-4db6-9121-b0b5ae4382be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2771476c-7666-4b91-a186-f6007c64a591-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.034476 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.034470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.135718 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.135907 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135744    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gnsb\" (UniqueName: \"kubernetes.io/projected/ab6a7f45-f614-4db6-9121-b0b5ae4382be-kube-api-access-2gnsb\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.135907 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135774    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2g2v9\" (UniqueName: \"kubernetes.io/projected/2771476c-7666-4b91-a186-f6007c64a591-kube-api-access-2g2v9\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.135907 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.135907 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135824    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.135907 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab6a7f45-f614-4db6-9121-b0b5ae4382be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.136195 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.135988    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2771476c-7666-4b91-a186-f6007c64a591-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.136195 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.136044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.136791 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.136763    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2771476c-7666-4b91-a186-f6007c64a591-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.138644 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.138619    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.138983 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.138963    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-ca\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.139061 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.138979    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.139061 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.138970    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2771476c-7666-4b91-a186-f6007c64a591-hub\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.139061 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.139052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab6a7f45-f614-4db6-9121-b0b5ae4382be-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.148623 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.148597    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2g2v9\" (UniqueName: \"kubernetes.io/projected/2771476c-7666-4b91-a186-f6007c64a591-kube-api-access-2g2v9\") pod \"cluster-proxy-proxy-agent-8486c69b47-khrtp\" (UID: \"2771476c-7666-4b91-a186-f6007c64a591\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.149570 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.149551    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gnsb\" (UniqueName: \"kubernetes.io/projected/ab6a7f45-f614-4db6-9121-b0b5ae4382be-kube-api-access-2gnsb\") pod \"managed-serviceaccount-addon-agent-f6ff65f94-cz4xh\" (UID: \"ab6a7f45-f614-4db6-9121-b0b5ae4382be\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.250233 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.250154    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 16:27:05.254001 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.253984    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"
Jul 17 16:27:05.260724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.260702    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p9jsh\""
Jul 17 16:27:05.268956 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.268731    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"
Jul 17 16:27:05.415479 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.415454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp"]
Jul 17 16:27:05.418009 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:05.417984    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2771476c_7666_4b91_a186_f6007c64a591.slice/crio-beaafbd15f11c811a611879e967398541f2c91e6229941cccd8f37b292080218 WatchSource:0}: Error finding container beaafbd15f11c811a611879e967398541f2c91e6229941cccd8f37b292080218: Status 404 returned error can't find the container with id beaafbd15f11c811a611879e967398541f2c91e6229941cccd8f37b292080218
Jul 17 16:27:05.424728 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.424703    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh"]
Jul 17 16:27:05.427740 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:05.427709    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab6a7f45_f614_4db6_9121_b0b5ae4382be.slice/crio-2c13d4820f9c5e46d1c0df78d7727d80fa77df8719c9a762aeffb5987e42f0f4 WatchSource:0}: Error finding container 2c13d4820f9c5e46d1c0df78d7727d80fa77df8719c9a762aeffb5987e42f0f4: Status 404 returned error can't find the container with id 2c13d4820f9c5e46d1c0df78d7727d80fa77df8719c9a762aeffb5987e42f0f4
Jul 17 16:27:05.751102 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.751057    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh" event={"ID":"ab6a7f45-f614-4db6-9121-b0b5ae4382be","Type":"ContainerStarted","Data":"2c13d4820f9c5e46d1c0df78d7727d80fa77df8719c9a762aeffb5987e42f0f4"}
Jul 17 16:27:05.752062 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:05.752042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp" event={"ID":"2771476c-7666-4b91-a186-f6007c64a591","Type":"ContainerStarted","Data":"beaafbd15f11c811a611879e967398541f2c91e6229941cccd8f37b292080218"}
Jul 17 16:27:06.669839 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:06.669778    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mjwb8"
Jul 17 16:27:09.766215 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:09.766179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp" event={"ID":"2771476c-7666-4b91-a186-f6007c64a591","Type":"ContainerStarted","Data":"1470843ae44bfd07b894744b54fd85dbb4f2607b1b8274b5764c04ccdd6f97d2"}
Jul 17 16:27:09.766215 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:09.766221    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp" event={"ID":"2771476c-7666-4b91-a186-f6007c64a591","Type":"ContainerStarted","Data":"6032b9726706fbe1fb263ce5167ddce58bac8ad7cc1e0f9af882000e7dada444"}
Jul 17 16:27:09.766770 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:09.766238    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp" event={"ID":"2771476c-7666-4b91-a186-f6007c64a591","Type":"ContainerStarted","Data":"4e20ff6ffd7a91cca5548264c60becec9dd9444a7f8e2b91da71d353fc01819a"}
Jul 17 16:27:09.784080 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:09.784035    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8486c69b47-khrtp" podStartSLOduration=2.126179699 podStartE2EDuration="5.784020981s" totalImagesPullingTime="3.657841282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:09.782948372 +0000 UTC m=+64.895490947" watchObservedRunningTime="2026-07-17 16:27:09.784020981 +0000 UTC m=+64.896563535"
Jul 17 16:27:10.740993 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:10.740957    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gv9nc"
Jul 17 16:27:11.082141 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.082024    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:27:11.082141 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.082093    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:27:11.084651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.084627    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 16:27:11.084651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.084642    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 16:27:11.095073 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.095039    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77024620-0563-4b23-9fec-b1f43193e81e-metrics-certs\") pod \"network-metrics-daemon-d5vch\" (UID: \"77024620-0563-4b23-9fec-b1f43193e81e\") " pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:27:11.095189 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.095078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c9d76e05-0fda-4a65-a3de-c656941e5799-original-pull-secret\") pod \"global-pull-secret-syncer-cqmvb\" (UID: \"c9d76e05-0fda-4a65-a3de-c656941e5799\") " pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:27:11.182498 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.182460    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:27:11.184971 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.184951    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 16:27:11.195568 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.195549    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 16:27:11.206291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.206259    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq8tj\" (UniqueName: \"kubernetes.io/projected/c3a3a52a-aff9-4194-a960-4ebae9b31ba5-kube-api-access-dq8tj\") pod \"network-check-target-kwxbx\" (UID: \"c3a3a52a-aff9-4194-a960-4ebae9b31ba5\") " pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:27:11.325518 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.325484    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h7wh7\""
Jul 17 16:27:11.331407 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.331385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-cqmvb"
Jul 17 16:27:11.333514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.333467    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d5vch"
Jul 17 16:27:11.341423 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.341391    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-54g7g\""
Jul 17 16:27:11.349772 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.349734    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:27:11.479192 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.479161    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d5vch"]
Jul 17 16:27:11.485196 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:11.485161    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77024620_0563_4b23_9fec_b1f43193e81e.slice/crio-ccc01a024de9b82706c4f22868adbf771b0a8e9262cc573918fd7a22453b3286 WatchSource:0}: Error finding container ccc01a024de9b82706c4f22868adbf771b0a8e9262cc573918fd7a22453b3286: Status 404 returned error can't find the container with id ccc01a024de9b82706c4f22868adbf771b0a8e9262cc573918fd7a22453b3286
Jul 17 16:27:11.493896 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.493865    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-cqmvb"]
Jul 17 16:27:11.497252 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:11.497224    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d76e05_0fda_4a65_a3de_c656941e5799.slice/crio-ecc45a647602a90db59deeeca56a4087dc16e4631344d238f3f90aa7319c76d9 WatchSource:0}: Error finding container ecc45a647602a90db59deeeca56a4087dc16e4631344d238f3f90aa7319c76d9: Status 404 returned error can't find the container with id ecc45a647602a90db59deeeca56a4087dc16e4631344d238f3f90aa7319c76d9
Jul 17 16:27:11.516160 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.516107    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kwxbx"]
Jul 17 16:27:11.519607 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:11.519580    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a3a52a_aff9_4194_a960_4ebae9b31ba5.slice/crio-f19c74c282584d43c80553591ec4c08d4ccab49c98291464ff23141a8e4a141a WatchSource:0}: Error finding container f19c74c282584d43c80553591ec4c08d4ccab49c98291464ff23141a8e4a141a: Status 404 returned error can't find the container with id f19c74c282584d43c80553591ec4c08d4ccab49c98291464ff23141a8e4a141a
Jul 17 16:27:11.775033 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.774989    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwxbx" event={"ID":"c3a3a52a-aff9-4194-a960-4ebae9b31ba5","Type":"ContainerStarted","Data":"f19c74c282584d43c80553591ec4c08d4ccab49c98291464ff23141a8e4a141a"}
Jul 17 16:27:11.776267 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.776234    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5vch" event={"ID":"77024620-0563-4b23-9fec-b1f43193e81e","Type":"ContainerStarted","Data":"ccc01a024de9b82706c4f22868adbf771b0a8e9262cc573918fd7a22453b3286"}
Jul 17 16:27:11.777337 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:11.777313    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqmvb" event={"ID":"c9d76e05-0fda-4a65-a3de-c656941e5799","Type":"ContainerStarted","Data":"ecc45a647602a90db59deeeca56a4087dc16e4631344d238f3f90aa7319c76d9"}
Jul 17 16:27:12.785917 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:12.785876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5vch" event={"ID":"77024620-0563-4b23-9fec-b1f43193e81e","Type":"ContainerStarted","Data":"0312c7e74bc17d15ea8f999e4633ee22c2d46228af2f3c647c0bd109d3378d0f"}
Jul 17 16:27:12.786426 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:12.785941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d5vch" event={"ID":"77024620-0563-4b23-9fec-b1f43193e81e","Type":"ContainerStarted","Data":"1be1772222554c1125b2dd29fc3b115d0e73904f8f5b0405194f2c8524547492"}
Jul 17 16:27:16.225972 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:27:16.225921    2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d: fetching blob: received unexpected HTTP status: 504 Gateway Timeout; artifact err: provided artifact is a container image" image="registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72"
Jul 17 16:27:16.226371 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:27:16.226050    2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container addon-agent start failed in pod managed-serviceaccount-addon-agent-f6ff65f94-cz4xh_open-cluster-management-agent-addon(ab6a7f45-f614-4db6-9121-b0b5ae4382be): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d: fetching blob: received unexpected HTTP status: 504 Gateway Timeout; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 16:27:16.226371 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:27:16.226089    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d: fetching blob: received unexpected HTTP status: 504 Gateway Timeout; artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh" podUID="ab6a7f45-f614-4db6-9121-b0b5ae4382be"
Jul 17 16:27:16.800908 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.800870    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kwxbx" event={"ID":"c3a3a52a-aff9-4194-a960-4ebae9b31ba5","Type":"ContainerStarted","Data":"58026a3c382d1a1fc033f6bea762575c667025fbf55a1935d77859bfe95d4683"}
Jul 17 16:27:16.801101 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.800967    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:27:16.802266 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.802241    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-cqmvb" event={"ID":"c9d76e05-0fda-4a65-a3de-c656941e5799","Type":"ContainerStarted","Data":"0a13f590cd048e78bcf41b14f3dc4ba40c10168c365cd3ca9f9d071ce537d3b9"}
Jul 17 16:27:16.803278 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:27:16.803251    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"registry.redhat.io/multicluster-engine/managed-serviceaccount-rhel9@sha256:6270079008ddaa493b09474324185a9224c3662bd93826c447f03f09cdd49a72\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:e17f05d1f8b2f515954250c3c32c313998badd0cfe4355c10908c8d74bcede8d: fetching blob: received unexpected HTTP status: 504 Gateway Timeout; artifact err: provided artifact is a container image\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh" podUID="ab6a7f45-f614-4db6-9121-b0b5ae4382be"
Jul 17 16:27:16.817478 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.817428    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kwxbx" podStartSLOduration=67.219863979 podStartE2EDuration="1m11.817409788s" totalImagesPullingTime="4.597545809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:16.817301952 +0000 UTC m=+71.929844549" watchObservedRunningTime="2026-07-17 16:27:16.817409788 +0000 UTC m=+71.929952364"
Jul 17 16:27:16.817778 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.817734    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d5vch" podStartSLOduration=70.739971325 podStartE2EDuration="1m11.817721174s" totalImagesPullingTime="1.077749849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:12.801803419 +0000 UTC m=+67.914346020" watchObservedRunningTime="2026-07-17 16:27:16.817721174 +0000 UTC m=+71.930263754"
Jul 17 16:27:16.849099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:16.849038    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-cqmvb" podStartSLOduration=67.226385126 podStartE2EDuration="1m11.849022718s" totalImagesPullingTime="4.622637592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:16.848878472 +0000 UTC m=+71.961421086" watchObservedRunningTime="2026-07-17 16:27:16.849022718 +0000 UTC m=+71.961565295"
Jul 17 16:27:31.851506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:31.851467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh" event={"ID":"ab6a7f45-f614-4db6-9121-b0b5ae4382be","Type":"ContainerStarted","Data":"dbd493a6a20982fc154e7cd22a5d483732c93124d924630624f5c6b869eea113"}
Jul 17 16:27:31.867630 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:31.867574    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f6ff65f94-cz4xh" podStartSLOduration=2.362343271 podStartE2EDuration="27.867557491s" totalImagesPullingTime="25.50521422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 16:27:31.866033828 +0000 UTC m=+86.978576402" watchObservedRunningTime="2026-07-17 16:27:31.867557491 +0000 UTC m=+86.980100044"
Jul 17 16:27:47.806779 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:47.806737    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4jzm4"]
Jul 17 16:27:48.003506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.003463    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kwxbx"
Jul 17 16:27:48.003681 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.003568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.008293 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.008268    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 16:27:48.008708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.008686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 16:27:48.008829 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.008748    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 16:27:48.008829 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.008694    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zdw49\""
Jul 17 16:27:48.009325 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.009309    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 16:27:48.011017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.010995    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 16:27:48.011884 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.011865    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 16:27:48.030971 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.030930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-root\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031118 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.030984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-sys\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031118 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031058    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-tls\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031118 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031292 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-textfile\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031292 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031222    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-metrics-client-ca\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031292 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-wtmp\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.031396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.031331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkdnc\" (UniqueName: \"kubernetes.io/projected/b2e78b46-7af1-4d36-92ac-933bb4f603ac-kube-api-access-rkdnc\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.131732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-root\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.131732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-sys\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.131732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-tls\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.131732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.131732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131737    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-textfile\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131737    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-root\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-metrics-client-ca\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131773    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-wtmp\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131799    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-sys\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkdnc\" (UniqueName: \"kubernetes.io/projected/b2e78b46-7af1-4d36-92ac-933bb4f603ac-kube-api-access-rkdnc\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132099 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.131967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-wtmp\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132414 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.132308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-textfile\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132468 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.132446    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.132578 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.132563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e78b46-7af1-4d36-92ac-933bb4f603ac-metrics-client-ca\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.134261 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.134240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.134385 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.134370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b2e78b46-7af1-4d36-92ac-933bb4f603ac-node-exporter-tls\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.152138 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.152097    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkdnc\" (UniqueName: \"kubernetes.io/projected/b2e78b46-7af1-4d36-92ac-933bb4f603ac-kube-api-access-rkdnc\") pod \"node-exporter-4jzm4\" (UID: \"b2e78b46-7af1-4d36-92ac-933bb4f603ac\") " pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.312481 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.312441    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jzm4"
Jul 17 16:27:48.353777 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:48.353747    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e78b46_7af1_4d36_92ac_933bb4f603ac.slice/crio-a91082c4706a5166897a33484e4c6facd87eaaebdc4d40a8dbfe34c14fd89965 WatchSource:0}: Error finding container a91082c4706a5166897a33484e4c6facd87eaaebdc4d40a8dbfe34c14fd89965: Status 404 returned error can't find the container with id a91082c4706a5166897a33484e4c6facd87eaaebdc4d40a8dbfe34c14fd89965
Jul 17 16:27:48.905669 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:48.905633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jzm4" event={"ID":"b2e78b46-7af1-4d36-92ac-933bb4f603ac","Type":"ContainerStarted","Data":"a91082c4706a5166897a33484e4c6facd87eaaebdc4d40a8dbfe34c14fd89965"}
Jul 17 16:27:49.910512 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:49.910476    2558 generic.go:356] "Generic (PLEG): container finished" podID="b2e78b46-7af1-4d36-92ac-933bb4f603ac" containerID="fffac0b4c40a7a1a2fb3aa656db33415c9d9b59230259b06007fc433bfa7aca1" exitCode=0
Jul 17 16:27:49.910883 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:49.910553    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jzm4" event={"ID":"b2e78b46-7af1-4d36-92ac-933bb4f603ac","Type":"ContainerDied","Data":"fffac0b4c40a7a1a2fb3aa656db33415c9d9b59230259b06007fc433bfa7aca1"}
Jul 17 16:27:50.879991 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.879954    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"]
Jul 17 16:27:50.882194 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.882177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.887396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.887331    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 17 16:27:50.887396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.887330    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 17 16:27:50.887614 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.887532    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 17 16:27:50.887700 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.887673    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bt4jhqm3gqit1\""
Jul 17 16:27:50.887700 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.887688    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 17 16:27:50.888614 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.888315    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 17 16:27:50.888614 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.888344    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vh5tw\""
Jul 17 16:27:50.904325 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.904291    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"]
Jul 17 16:27:50.920319 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.920280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jzm4" event={"ID":"b2e78b46-7af1-4d36-92ac-933bb4f603ac","Type":"ContainerStarted","Data":"237ae07f14d5ea74c3c07e2cc138455c9c0cb65df24588e7305c7511163aed9b"}
Jul 17 16:27:50.920671 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.920356    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jzm4" event={"ID":"b2e78b46-7af1-4d36-92ac-933bb4f603ac","Type":"ContainerStarted","Data":"145104405f7db90352ebb0bbfb791392954f35f73167e969e11f060db0c3594e"}
Jul 17 16:27:50.952100 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.952037    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4jzm4" podStartSLOduration=2.711116782 podStartE2EDuration="3.952019035s" totalImagesPullingTime="1.169281478s" totalInitContainerRuntime="71.620775ms" isStatefulPod=true podCreationTimestamp="2026-07-17 16:27:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:50.950763169 +0000 UTC m=+106.063305746" watchObservedRunningTime="2026-07-17 16:27:50.952019035 +0000 UTC m=+106.064561611"
Jul 17 16:27:50.953444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-grpc-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953521 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953570 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953536    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953570 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953567    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458a8ac7-34c5-4f4c-9d88-95660a415b03-metrics-client-ca\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953662 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953588    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953662 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953636    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncsz4\" (UniqueName: \"kubernetes.io/projected/458a8ac7-34c5-4f4c-9d88-95660a415b03-kube-api-access-ncsz4\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:50.953927 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:50.953733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.054928 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.054884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458a8ac7-34c5-4f4c-9d88-95660a415b03-metrics-client-ca\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.054928 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.054931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.054984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.055031    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncsz4\" (UniqueName: \"kubernetes.io/projected/458a8ac7-34c5-4f4c-9d88-95660a415b03-kube-api-access-ncsz4\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.055057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.055096    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-grpc-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.055174    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.055371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.055203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.056305 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.056263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/458a8ac7-34c5-4f4c-9d88-95660a415b03-metrics-client-ca\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058172 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058114    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058172 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058159    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058351 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-grpc-tls\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058572 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058691 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.058732 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.058669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/458a8ac7-34c5-4f4c-9d88-95660a415b03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.063666 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.063639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncsz4\" (UniqueName: \"kubernetes.io/projected/458a8ac7-34c5-4f4c-9d88-95660a415b03-kube-api-access-ncsz4\") pod \"thanos-querier-85d5dff5b8-tpfsx\" (UID: \"458a8ac7-34c5-4f4c-9d88-95660a415b03\") " pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.190740 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.190711    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:27:51.328794 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.328748    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"]
Jul 17 16:27:51.331411 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:51.331386    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod458a8ac7_34c5_4f4c_9d88_95660a415b03.slice/crio-5aa9b72c237d9e0512ade16f5bdf483bc6e332e9fd676cdbbb3f88d020910f8d WatchSource:0}: Error finding container 5aa9b72c237d9e0512ade16f5bdf483bc6e332e9fd676cdbbb3f88d020910f8d: Status 404 returned error can't find the container with id 5aa9b72c237d9e0512ade16f5bdf483bc6e332e9fd676cdbbb3f88d020910f8d
Jul 17 16:27:51.925015 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:51.924975    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"5aa9b72c237d9e0512ade16f5bdf483bc6e332e9fd676cdbbb3f88d020910f8d"}
Jul 17 16:27:52.207787 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.207679    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xf2nt_c77d63b4-d290-4121-b00b-1caaf25d0346/serve-healthcheck-canary/0.log"
Jul 17 16:27:52.485823 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.485745    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"]
Jul 17 16:27:52.487762 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.487746    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.490718 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.490697    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hfkfb\""
Jul 17 16:27:52.490836 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.490793    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 17 16:27:52.508543 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.508506    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"]
Jul 17 16:27:52.567719 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.567681    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cfe023c3-ea33-4624-ad19-faabc231fe38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.567899 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.567739    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trn5v\" (UniqueName: \"kubernetes.io/projected/cfe023c3-ea33-4624-ad19-faabc231fe38-kube-api-access-trn5v\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.668539 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.668502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trn5v\" (UniqueName: \"kubernetes.io/projected/cfe023c3-ea33-4624-ad19-faabc231fe38-kube-api-access-trn5v\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.668719 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.668569    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cfe023c3-ea33-4624-ad19-faabc231fe38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.671433 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.671404    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cfe023c3-ea33-4624-ad19-faabc231fe38-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.676991 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.676966    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trn5v\" (UniqueName: \"kubernetes.io/projected/cfe023c3-ea33-4624-ad19-faabc231fe38-kube-api-access-trn5v\") pod \"monitoring-plugin-7b7b7bc8bf-p8h57\" (UID: \"cfe023c3-ea33-4624-ad19-faabc231fe38\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.797248 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.797155    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:52.945576 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:52.945521    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"]
Jul 17 16:27:52.949820 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:27:52.949791    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe023c3_ea33_4624_ad19_faabc231fe38.slice/crio-c30c6f281afbd7d8c8ab6f5cde953f1ed0507687c878a4f7cb438ccc4db224e5 WatchSource:0}: Error finding container c30c6f281afbd7d8c8ab6f5cde953f1ed0507687c878a4f7cb438ccc4db224e5: Status 404 returned error can't find the container with id c30c6f281afbd7d8c8ab6f5cde953f1ed0507687c878a4f7cb438ccc4db224e5
Jul 17 16:27:53.936797 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:53.936761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57" event={"ID":"cfe023c3-ea33-4624-ad19-faabc231fe38","Type":"ContainerStarted","Data":"c30c6f281afbd7d8c8ab6f5cde953f1ed0507687c878a4f7cb438ccc4db224e5"}
Jul 17 16:27:53.939285 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:53.939252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"2ee6f36bf06a2aa258c1b4975a9cfe1321bba58f6b76e588d8d82f678c33a3fd"}
Jul 17 16:27:53.939427 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:53.939319    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"5e8ecc45e1856b0f3cb12f142df7c231b978f16edaf970bf4768c53310472450"}
Jul 17 16:27:53.939427 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:53.939354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"d638124f1714e0ea89c31c30c84db8ff3da09c80e52de7d8fb94b9020194cd56"}
Jul 17 16:27:54.944470 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.944434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57" event={"ID":"cfe023c3-ea33-4624-ad19-faabc231fe38","Type":"ContainerStarted","Data":"a3e88b2f802ad8e93bb6fe5456c89eb1b333577e4c0256f87139d773de07fad7"}
Jul 17 16:27:54.944870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.944500    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:54.953047 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.953011    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57"
Jul 17 16:27:54.953643 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.953616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"7df9a2e12251a60eb702a958e2885eb01c4aff9749ec1e2687e64967b8f9dc09"}
Jul 17 16:27:54.953743 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.953693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"d5cf9007162ea4f2ded0676586da38d6fcb5aa06ad3591090dfd3db2eee14cb6"}
Jul 17 16:27:54.963578 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:54.963533    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-p8h57" podStartSLOduration=1.111772017 podStartE2EDuration="2.963516967s" totalImagesPullingTime="1.85174495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:54.962590898 +0000 UTC m=+110.075133475" watchObservedRunningTime="2026-07-17 16:27:54.963516967 +0000 UTC m=+110.076059520"
Jul 17 16:27:55.960316 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:55.960274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" event={"ID":"458a8ac7-34c5-4f4c-9d88-95660a415b03","Type":"ContainerStarted","Data":"0ac39f9a7f80c65a94a4b7150a253358039ace46ce33bf15439a2476105b4ec2"}
Jul 17 16:27:56.004083 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:56.004025    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx" podStartSLOduration=2.727986508 podStartE2EDuration="6.004009144s" totalImagesPullingTime="3.276022636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:27:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:27:56.003681932 +0000 UTC m=+111.116224509" watchObservedRunningTime="2026-07-17 16:27:56.004009144 +0000 UTC m=+111.116551719"
Jul 17 16:27:56.963672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:27:56.963643    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:28:02.973323 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:28:02.973296    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85d5dff5b8-tpfsx"
Jul 17 16:30:15.661166 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.661115    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"]
Jul 17 16:30:15.664171 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.664152    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.666850 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.666824    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t2hm8\""
Jul 17 16:30:15.666977 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.666962    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 16:30:15.667599 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.667582    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 16:30:15.679000 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.678971    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"]
Jul 17 16:30:15.787204 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.787170    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.787463 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.787224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.787463 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.787247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65vcs\" (UniqueName: \"kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.887845 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.887810    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.887940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.887849    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65vcs\" (UniqueName: \"kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.887940 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.887889    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.888232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.888212    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.888274 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.888240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.897768 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.897741    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65vcs\" (UniqueName: \"kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:15.973750 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:15.973661    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:16.114993 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:16.114960    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"]
Jul 17 16:30:16.118328 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:30:16.118302    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod580e8e76_a78f_45af_b709_772158ba9f55.slice/crio-bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f WatchSource:0}: Error finding container bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f: Status 404 returned error can't find the container with id bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f
Jul 17 16:30:16.423504 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:16.423467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl" event={"ID":"580e8e76-a78f-45af-b709-772158ba9f55","Type":"ContainerStarted","Data":"bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f"}
Jul 17 16:30:23.450111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:23.450075    2558 generic.go:356] "Generic (PLEG): container finished" podID="580e8e76-a78f-45af-b709-772158ba9f55" containerID="7af0f53fd60ef021dec6506ec02c8f72cc8ba62efbda5c2e66aecce384989942" exitCode=0
Jul 17 16:30:23.450523 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:23.450153    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl" event={"ID":"580e8e76-a78f-45af-b709-772158ba9f55","Type":"ContainerDied","Data":"7af0f53fd60ef021dec6506ec02c8f72cc8ba62efbda5c2e66aecce384989942"}
Jul 17 16:30:26.462759 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:26.462721    2558 generic.go:356] "Generic (PLEG): container finished" podID="580e8e76-a78f-45af-b709-772158ba9f55" containerID="98793fa5876a6946d99ebe5636bdb63e5510baeeb1890d367eb9e1d5edc6bf57" exitCode=0
Jul 17 16:30:26.463204 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:26.462768    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl" event={"ID":"580e8e76-a78f-45af-b709-772158ba9f55","Type":"ContainerDied","Data":"98793fa5876a6946d99ebe5636bdb63e5510baeeb1890d367eb9e1d5edc6bf57"}
Jul 17 16:30:34.494175 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:34.494117    2558 generic.go:356] "Generic (PLEG): container finished" podID="580e8e76-a78f-45af-b709-772158ba9f55" containerID="5eccd2afa668a2b116b133bcaeadb9266058405e46afb51ab056fe26e8f2dbca" exitCode=0
Jul 17 16:30:34.494545 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:34.494185    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl" event={"ID":"580e8e76-a78f-45af-b709-772158ba9f55","Type":"ContainerDied","Data":"5eccd2afa668a2b116b133bcaeadb9266058405e46afb51ab056fe26e8f2dbca"}
Jul 17 16:30:35.619310 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.619280    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:35.640162 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.640110    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util\") pod \"580e8e76-a78f-45af-b709-772158ba9f55\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") "
Jul 17 16:30:35.640341 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.640177    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle\") pod \"580e8e76-a78f-45af-b709-772158ba9f55\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") "
Jul 17 16:30:35.640341 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.640214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65vcs\" (UniqueName: \"kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs\") pod \"580e8e76-a78f-45af-b709-772158ba9f55\" (UID: \"580e8e76-a78f-45af-b709-772158ba9f55\") "
Jul 17 16:30:35.640930 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.640892    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle" (OuterVolumeSpecName: "bundle") pod "580e8e76-a78f-45af-b709-772158ba9f55" (UID: "580e8e76-a78f-45af-b709-772158ba9f55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:30:35.642696 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.642662    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs" (OuterVolumeSpecName: "kube-api-access-65vcs") pod "580e8e76-a78f-45af-b709-772158ba9f55" (UID: "580e8e76-a78f-45af-b709-772158ba9f55"). InnerVolumeSpecName "kube-api-access-65vcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:30:35.645775 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.645742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util" (OuterVolumeSpecName: "util") pod "580e8e76-a78f-45af-b709-772158ba9f55" (UID: "580e8e76-a78f-45af-b709-772158ba9f55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:30:35.741286 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.741235    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65vcs\" (UniqueName: \"kubernetes.io/projected/580e8e76-a78f-45af-b709-772158ba9f55-kube-api-access-65vcs\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:35.741286 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.741279    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:35.741286 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:35.741291    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/580e8e76-a78f-45af-b709-772158ba9f55-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:36.502486 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:36.502455    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl"
Jul 17 16:30:36.502650 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:36.502457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408rbtl" event={"ID":"580e8e76-a78f-45af-b709-772158ba9f55","Type":"ContainerDied","Data":"bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f"}
Jul 17 16:30:36.502650 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:36.502565    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb29c58b52d1067d713bb2384b1aeb28fe4a6931433366c5100fe2c4a8fa8d0f"
Jul 17 16:30:43.732814 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.732776    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"]
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733018    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="util"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733029    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="util"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733037    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="pull"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733043    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="pull"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733051    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="extract"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733057    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="extract"
Jul 17 16:30:43.733235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.733115    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="580e8e76-a78f-45af-b709-772158ba9f55" containerName="extract"
Jul 17 16:30:43.736090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.736074    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.738610 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.738580    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 17 16:30:43.738770 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.738751    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-djwfm\""
Jul 17 16:30:43.739029 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.739005    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 17 16:30:43.751711 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.751685    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"]
Jul 17 16:30:43.797150 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.797087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h24d2\" (UniqueName: \"kubernetes.io/projected/05410518-8ac9-4e95-9bfa-0739eefd35fa-kube-api-access-h24d2\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.797309 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.797209    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05410518-8ac9-4e95-9bfa-0739eefd35fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.898381 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.898341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05410518-8ac9-4e95-9bfa-0739eefd35fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.898536 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.898410    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h24d2\" (UniqueName: \"kubernetes.io/projected/05410518-8ac9-4e95-9bfa-0739eefd35fa-kube-api-access-h24d2\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.898724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.898701    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05410518-8ac9-4e95-9bfa-0739eefd35fa-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:43.906763 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:43.906740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h24d2\" (UniqueName: \"kubernetes.io/projected/05410518-8ac9-4e95-9bfa-0739eefd35fa-kube-api-access-h24d2\") pod \"cert-manager-operator-controller-manager-55c444bf86-qkpff\" (UID: \"05410518-8ac9-4e95-9bfa-0739eefd35fa\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:44.044994 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:44.044904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"
Jul 17 16:30:44.188473 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:44.188448    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff"]
Jul 17 16:30:44.191219 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:30:44.191192    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05410518_8ac9_4e95_9bfa_0739eefd35fa.slice/crio-3c5c384cb09d262b328d7cf50f802b8d39c9816818dabf2fb8042c04e967ce2d WatchSource:0}: Error finding container 3c5c384cb09d262b328d7cf50f802b8d39c9816818dabf2fb8042c04e967ce2d: Status 404 returned error can't find the container with id 3c5c384cb09d262b328d7cf50f802b8d39c9816818dabf2fb8042c04e967ce2d
Jul 17 16:30:44.530932 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:44.530891    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff" event={"ID":"05410518-8ac9-4e95-9bfa-0739eefd35fa","Type":"ContainerStarted","Data":"3c5c384cb09d262b328d7cf50f802b8d39c9816818dabf2fb8042c04e967ce2d"}
Jul 17 16:30:46.542595 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:46.540619    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff" event={"ID":"05410518-8ac9-4e95-9bfa-0739eefd35fa","Type":"ContainerStarted","Data":"cf6b3081e0ef2ee496bbf58108941c322cdff13e40baf16cacdc1a3070de258a"}
Jul 17 16:30:46.562485 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:46.562421    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qkpff" podStartSLOduration=1.6297413889999999 podStartE2EDuration="3.562402666s" totalImagesPullingTime="1.932661277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:30:46.560653974 +0000 UTC m=+281.673196551" watchObservedRunningTime="2026-07-17 16:30:46.562402666 +0000 UTC m=+281.674945242"
Jul 17 16:30:47.749444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.749403    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"]
Jul 17 16:30:47.752468 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.752447    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.754944 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.754918    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 16:30:47.755051 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.754999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 16:30:47.755790 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.755775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t2hm8\""
Jul 17 16:30:47.766012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.765984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"]
Jul 17 16:30:47.825283 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.825240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbw6q\" (UniqueName: \"kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.825473 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.825308    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.825473 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.825353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.926351 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.926311    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.926514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.926365    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbw6q\" (UniqueName: \"kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.926514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.926400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.926733 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.926712    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.926773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.926740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:47.936428 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:47.936398    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbw6q\" (UniqueName: \"kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:48.060651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:48.060561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:48.193537 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:48.193504    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"]
Jul 17 16:30:48.196249 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:30:48.196217    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21628464_6411_425e_8f68_72a961380f6e.slice/crio-f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1 WatchSource:0}: Error finding container f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1: Status 404 returned error can't find the container with id f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1
Jul 17 16:30:48.548833 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:48.548796    2558 generic.go:356] "Generic (PLEG): container finished" podID="21628464-6411-425e-8f68-72a961380f6e" containerID="04613a17dc6d5d945bc160a3180f2b006fc4b1e4cac5dec772a76d5cdcfb3153" exitCode=0
Jul 17 16:30:48.549004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:48.548840    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp" event={"ID":"21628464-6411-425e-8f68-72a961380f6e","Type":"ContainerDied","Data":"04613a17dc6d5d945bc160a3180f2b006fc4b1e4cac5dec772a76d5cdcfb3153"}
Jul 17 16:30:48.549004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:48.548885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp" event={"ID":"21628464-6411-425e-8f68-72a961380f6e","Type":"ContainerStarted","Data":"f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1"}
Jul 17 16:30:51.562789 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:51.562752    2558 generic.go:356] "Generic (PLEG): container finished" podID="21628464-6411-425e-8f68-72a961380f6e" containerID="9c6114e1825a19af7b028757abb71c1f529e2f85d3442228b8b7bf3ee6e86814" exitCode=0
Jul 17 16:30:51.563205 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:51.562842    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp" event={"ID":"21628464-6411-425e-8f68-72a961380f6e","Type":"ContainerDied","Data":"9c6114e1825a19af7b028757abb71c1f529e2f85d3442228b8b7bf3ee6e86814"}
Jul 17 16:30:52.568688 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:52.568653    2558 generic.go:356] "Generic (PLEG): container finished" podID="21628464-6411-425e-8f68-72a961380f6e" containerID="fa69cdc132b947f0f808b0c9754b891e249767c64a811690805703ed86de901b" exitCode=0
Jul 17 16:30:52.569086 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:52.568746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp" event={"ID":"21628464-6411-425e-8f68-72a961380f6e","Type":"ContainerDied","Data":"fa69cdc132b947f0f808b0c9754b891e249767c64a811690805703ed86de901b"}
Jul 17 16:30:53.545326 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.545283    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"]
Jul 17 16:30:53.564817 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.564778    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"]
Jul 17 16:30:53.564967 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.564907    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.567320 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.567298    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 17 16:30:53.568273 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.568255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 17 16:30:53.568400 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.568278    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2zskh\""
Jul 17 16:30:53.669451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.669420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg55q\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-kube-api-access-rg55q\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.669828 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.669478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.717663 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.717627    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:53.770525 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770486    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle\") pod \"21628464-6411-425e-8f68-72a961380f6e\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") "
Jul 17 16:30:53.770525 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770531    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbw6q\" (UniqueName: \"kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q\") pod \"21628464-6411-425e-8f68-72a961380f6e\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") "
Jul 17 16:30:53.770773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770562    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util\") pod \"21628464-6411-425e-8f68-72a961380f6e\" (UID: \"21628464-6411-425e-8f68-72a961380f6e\") "
Jul 17 16:30:53.770773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770701    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg55q\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-kube-api-access-rg55q\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.770894 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770800    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.770988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.770966    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle" (OuterVolumeSpecName: "bundle") pod "21628464-6411-425e-8f68-72a961380f6e" (UID: "21628464-6411-425e-8f68-72a961380f6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:30:53.772786 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.772759    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q" (OuterVolumeSpecName: "kube-api-access-bbw6q") pod "21628464-6411-425e-8f68-72a961380f6e" (UID: "21628464-6411-425e-8f68-72a961380f6e"). InnerVolumeSpecName "kube-api-access-bbw6q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:30:53.778708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.778685    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.778827 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.778807    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg55q\" (UniqueName: \"kubernetes.io/projected/9559ad07-0303-4138-8808-a645e9a68f0f-kube-api-access-rg55q\") pod \"cert-manager-cainjector-559cdd8c87-zp4m2\" (UID: \"9559ad07-0303-4138-8808-a645e9a68f0f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:53.871429 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.871346    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:53.871429 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.871377    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbw6q\" (UniqueName: \"kubernetes.io/projected/21628464-6411-425e-8f68-72a961380f6e-kube-api-access-bbw6q\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:53.874225 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:53.874192    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"
Jul 17 16:30:54.024549 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.024515    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2"]
Jul 17 16:30:54.027709 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:30:54.027679    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9559ad07_0303_4138_8808_a645e9a68f0f.slice/crio-6023bb6c3b7de9aae0b7cd1a44951e35d605798d2f2073f54cb7623c64aac03e WatchSource:0}: Error finding container 6023bb6c3b7de9aae0b7cd1a44951e35d605798d2f2073f54cb7623c64aac03e: Status 404 returned error can't find the container with id 6023bb6c3b7de9aae0b7cd1a44951e35d605798d2f2073f54cb7623c64aac03e
Jul 17 16:30:54.320330 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.320286    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util" (OuterVolumeSpecName: "util") pod "21628464-6411-425e-8f68-72a961380f6e" (UID: "21628464-6411-425e-8f68-72a961380f6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:30:54.375686 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.375652    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21628464-6411-425e-8f68-72a961380f6e-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:30:54.578148 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.578043    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp"
Jul 17 16:30:54.578148 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.578069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnzmhp" event={"ID":"21628464-6411-425e-8f68-72a961380f6e","Type":"ContainerDied","Data":"f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1"}
Jul 17 16:30:54.578148 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.578118    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1bdf7614c8edf1a4f99e4c5faeb308cccd311fbae0490921bed43d352977ec1"
Jul 17 16:30:54.579260 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:54.579230    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2" event={"ID":"9559ad07-0303-4138-8808-a645e9a68f0f","Type":"ContainerStarted","Data":"6023bb6c3b7de9aae0b7cd1a44951e35d605798d2f2073f54cb7623c64aac03e"}
Jul 17 16:30:57.593243 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:57.593204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2" event={"ID":"9559ad07-0303-4138-8808-a645e9a68f0f","Type":"ContainerStarted","Data":"58fb94864d9b5349ab835986dca0c16865333265ecebc42d31d1456429831ff2"}
Jul 17 16:30:57.613986 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:30:57.613934    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zp4m2" podStartSLOduration=2.096919071 podStartE2EDuration="4.613919491s" totalImagesPullingTime="2.51700042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:30:57.612565538 +0000 UTC m=+292.725108115" watchObservedRunningTime="2026-07-17 16:30:57.613919491 +0000 UTC m=+292.726462066"
Jul 17 16:31:05.283741 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:05.283710    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:31:05.290238 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:05.290215    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:31:05.290658 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:05.290636    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 16:31:07.418290 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418257    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"]
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418520    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="extract"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418530    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="extract"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418541    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="util"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418546    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="util"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418552    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="pull"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418557    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="pull"
Jul 17 16:31:07.431291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.418602    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="21628464-6411-425e-8f68-72a961380f6e" containerName="extract"
Jul 17 16:31:07.439300 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.439272    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"]
Jul 17 16:31:07.439471 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.439417    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.442203 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.442182    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 17 16:31:07.443033 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.443016    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 17 16:31:07.443111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.443055    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t2hm8\""
Jul 17 16:31:07.472618 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.472586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgvt\" (UniqueName: \"kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.472818 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.472641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.472818 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.472677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.573183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.573139    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.573370 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.573201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.573370 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.573249    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgvt\" (UniqueName: \"kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.573477 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.573439    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.573533 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.573490    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.581832 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.581796    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgvt\" (UniqueName: \"kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.748313 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.748223    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:07.898540 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:07.898513    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"]
Jul 17 16:31:07.901003 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:07.900971    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4877497_9bf6_4d12_9358_99ddfb7b38f5.slice/crio-2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a WatchSource:0}: Error finding container 2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a: Status 404 returned error can't find the container with id 2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a
Jul 17 16:31:08.636411 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:08.636379    2558 generic.go:356] "Generic (PLEG): container finished" podID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerID="48d284da150b6f86e56209b4e7cdc4f49853eafac70a84c14657bdb910490f7d" exitCode=0
Jul 17 16:31:08.636911 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:08.636427    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4" event={"ID":"e4877497-9bf6-4d12-9358-99ddfb7b38f5","Type":"ContainerDied","Data":"48d284da150b6f86e56209b4e7cdc4f49853eafac70a84c14657bdb910490f7d"}
Jul 17 16:31:08.636911 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:08.636463    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4" event={"ID":"e4877497-9bf6-4d12-9358-99ddfb7b38f5","Type":"ContainerStarted","Data":"2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a"}
Jul 17 16:31:08.637048 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:08.637029    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:31:09.642496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:09.642408    2558 generic.go:356] "Generic (PLEG): container finished" podID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerID="4eb854d40f24237977ed5efb882561a5a50f87e1a3c8f42c68737503ffd6157b" exitCode=0
Jul 17 16:31:09.642908 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:09.642498    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4" event={"ID":"e4877497-9bf6-4d12-9358-99ddfb7b38f5","Type":"ContainerDied","Data":"4eb854d40f24237977ed5efb882561a5a50f87e1a3c8f42c68737503ffd6157b"}
Jul 17 16:31:10.650630 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:10.650600    2558 generic.go:356] "Generic (PLEG): container finished" podID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerID="7a44dac979e5fad30024f5289d3546f54e6d7bd2a7cad67a22e6ae19ce9b44ca" exitCode=0
Jul 17 16:31:10.651034 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:10.650673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4" event={"ID":"e4877497-9bf6-4d12-9358-99ddfb7b38f5","Type":"ContainerDied","Data":"7a44dac979e5fad30024f5289d3546f54e6d7bd2a7cad67a22e6ae19ce9b44ca"}
Jul 17 16:31:11.786704 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.786670    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:11.907518 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.907430    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle\") pod \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") "
Jul 17 16:31:11.907518 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.907468    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util\") pod \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") "
Jul 17 16:31:11.907701 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.907523    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzgvt\" (UniqueName: \"kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt\") pod \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\" (UID: \"e4877497-9bf6-4d12-9358-99ddfb7b38f5\") "
Jul 17 16:31:11.908149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.908083    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle" (OuterVolumeSpecName: "bundle") pod "e4877497-9bf6-4d12-9358-99ddfb7b38f5" (UID: "e4877497-9bf6-4d12-9358-99ddfb7b38f5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:31:11.909682 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.909660    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt" (OuterVolumeSpecName: "kube-api-access-jzgvt") pod "e4877497-9bf6-4d12-9358-99ddfb7b38f5" (UID: "e4877497-9bf6-4d12-9358-99ddfb7b38f5"). InnerVolumeSpecName "kube-api-access-jzgvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:31:11.912986 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:11.912964    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util" (OuterVolumeSpecName: "util") pod "e4877497-9bf6-4d12-9358-99ddfb7b38f5" (UID: "e4877497-9bf6-4d12-9358-99ddfb7b38f5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:31:12.008709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.008664    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:31:12.008709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.008699    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4877497-9bf6-4d12-9358-99ddfb7b38f5-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:31:12.008709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.008715    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzgvt\" (UniqueName: \"kubernetes.io/projected/e4877497-9bf6-4d12-9358-99ddfb7b38f5-kube-api-access-jzgvt\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:31:12.660113 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.660075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4" event={"ID":"e4877497-9bf6-4d12-9358-99ddfb7b38f5","Type":"ContainerDied","Data":"2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a"}
Jul 17 16:31:12.660304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.660087    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afb46r4"
Jul 17 16:31:12.660304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:12.660150    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d7c6064f90e199dc8927b21dbed908f464c24c905b788aec5c1cadb519a211a"
Jul 17 16:31:24.854352 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854316    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"]
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854568    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="util"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854578    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="util"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854588    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="pull"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854593    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="pull"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854606    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="extract"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854611    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="extract"
Jul 17 16:31:24.854825 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.854651    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4877497-9bf6-4d12-9358-99ddfb7b38f5" containerName="extract"
Jul 17 16:31:24.860087 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.860061    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.865529 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.865479    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 16:31:24.865815 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.865787    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4r79r\""
Jul 17 16:31:24.865988 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.865967    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 16:31:24.866235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.866205    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 16:31:24.866838 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.866819    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 16:31:24.877189 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.877164    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"]
Jul 17 16:31:24.897613 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.897571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.897812 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.897650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.897812 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.897693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-825ff\" (UniqueName: \"kubernetes.io/projected/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-kube-api-access-825ff\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.897812 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.897721    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.897812 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.897743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999055 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999015    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999055 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999055    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-825ff\" (UniqueName: \"kubernetes.io/projected/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-kube-api-access-825ff\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999336 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999336 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999336 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999116    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:24.999480 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:24.999453    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-manifests\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.001578 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.001555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-tmp\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.001691 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.001623    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.001767 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.001751    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.011370 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.011348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-825ff\" (UniqueName: \"kubernetes.io/projected/b8cb91c9-c7de-4c70-9508-f81e72b3ddf1-kube-api-access-825ff\") pod \"opendatahub-operator-controller-manager-5cc76599b9-2f9fn\" (UID: \"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.170456 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.170416    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:25.314513 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.314489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"]
Jul 17 16:31:25.317189 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:25.317163    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8cb91c9_c7de_4c70_9508_f81e72b3ddf1.slice/crio-818a0c90a4083c37cab1b2cfcf17a627d2201260e85d2c6109700462318351aa WatchSource:0}: Error finding container 818a0c90a4083c37cab1b2cfcf17a627d2201260e85d2c6109700462318351aa: Status 404 returned error can't find the container with id 818a0c90a4083c37cab1b2cfcf17a627d2201260e85d2c6109700462318351aa
Jul 17 16:31:25.714806 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:25.714767    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn" event={"ID":"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1","Type":"ContainerStarted","Data":"818a0c90a4083c37cab1b2cfcf17a627d2201260e85d2c6109700462318351aa"}
Jul 17 16:31:28.729400 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:28.729360    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn" event={"ID":"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1","Type":"ContainerStarted","Data":"7d8c99715fbf19f7cbbef4329ec08baac60c896e3a8084afc6b415578ee05325"}
Jul 17 16:31:29.734832 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:29.734790    2558 generic.go:356] "Generic (PLEG): container finished" podID="b8cb91c9-c7de-4c70-9508-f81e72b3ddf1" containerID="7d8c99715fbf19f7cbbef4329ec08baac60c896e3a8084afc6b415578ee05325" exitCode=0
Jul 17 16:31:29.735260 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:29.734873    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn" event={"ID":"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1","Type":"ContainerDied","Data":"7d8c99715fbf19f7cbbef4329ec08baac60c896e3a8084afc6b415578ee05325"}
Jul 17 16:31:30.741069 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:30.741034    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn" event={"ID":"b8cb91c9-c7de-4c70-9508-f81e72b3ddf1","Type":"ContainerStarted","Data":"c66b7292b791d9bb1ef3e27abfa678907e8d16e2c762e2cc3ff358e7fa44ddf6"}
Jul 17 16:31:30.741453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:30.741166    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:30.763682 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:30.763628    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn" podStartSLOduration=2.267245909 podStartE2EDuration="6.763610139s" totalImagesPullingTime="3.417407063s" totalInitContainerRuntime="1.078957167s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:30.762701629 +0000 UTC m=+325.875244251" watchObservedRunningTime="2026-07-17 16:31:30.763610139 +0000 UTC m=+325.876152793"
Jul 17 16:31:41.749465 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:41.749429    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc76599b9-2f9fn"
Jul 17 16:31:44.479097 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.479064    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnsxd"]
Jul 17 16:31:44.487206 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.487183    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.491844 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.491819    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 17 16:31:44.492192 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.492179    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-69r24\""
Jul 17 16:31:44.506854 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.506790    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnsxd"]
Jul 17 16:31:44.560701 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.560663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnppv\" (UniqueName: \"kubernetes.io/projected/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-kube-api-access-dnppv\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.560864 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.560742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.661580 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.661548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnppv\" (UniqueName: \"kubernetes.io/projected/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-kube-api-access-dnppv\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.661737 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.661613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.661737 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:44.661694    2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 17 16:31:44.661867 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:44.661745    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert podName:709d26af-cf5e-4fcf-a9a9-e00e69adb0d2 nodeName:}" failed. No retries permitted until 2026-07-17 16:31:45.16172952 +0000 UTC m=+340.274272073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert") pod "odh-model-controller-7998c67dc4-pnsxd" (UID: "709d26af-cf5e-4fcf-a9a9-e00e69adb0d2") : secret "odh-model-controller-webhook-cert" not found
Jul 17 16:31:44.673542 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.673500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnppv\" (UniqueName: \"kubernetes.io/projected/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-kube-api-access-dnppv\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:44.954191 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.954156    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwcng"]
Jul 17 16:31:44.957451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.957433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:44.960304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.960281    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 17 16:31:44.969477 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:44.969454    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwcng"]
Jul 17 16:31:45.064457 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.064415    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42n4\" (UniqueName: \"kubernetes.io/projected/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-kube-api-access-c42n4\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.064623 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.064477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.165376 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.165337    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42n4\" (UniqueName: \"kubernetes.io/projected/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-kube-api-access-c42n4\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.165572 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.165389    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:45.165572 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.165415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.165572 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:45.165535    2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 17 16:31:45.165716 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:45.165600    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs podName:c0b0458d-a47b-49eb-9cb2-cf82def5c1a5 nodeName:}" failed. No retries permitted until 2026-07-17 16:31:45.665580649 +0000 UTC m=+340.778123203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs") pod "model-serving-api-54d89bd5fc-qwcng" (UID: "c0b0458d-a47b-49eb-9cb2-cf82def5c1a5") : secret "model-serving-api-tls" not found
Jul 17 16:31:45.167987 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.167967    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/709d26af-cf5e-4fcf-a9a9-e00e69adb0d2-cert\") pod \"odh-model-controller-7998c67dc4-pnsxd\" (UID: \"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:45.175701 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.175675    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42n4\" (UniqueName: \"kubernetes.io/projected/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-kube-api-access-c42n4\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.398646 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.398540    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:45.536075 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.536043    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-pnsxd"]
Jul 17 16:31:45.538564 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:45.538531    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod709d26af_cf5e_4fcf_a9a9_e00e69adb0d2.slice/crio-eb71a584bc65ec68b3de8f5c7f26844a41c5478a2109463104b38cf503621612 WatchSource:0}: Error finding container eb71a584bc65ec68b3de8f5c7f26844a41c5478a2109463104b38cf503621612: Status 404 returned error can't find the container with id eb71a584bc65ec68b3de8f5c7f26844a41c5478a2109463104b38cf503621612
Jul 17 16:31:45.671552 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.671515    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.674151 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.674109    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0b0458d-a47b-49eb-9cb2-cf82def5c1a5-tls-certs\") pod \"model-serving-api-54d89bd5fc-qwcng\" (UID: \"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5\") " pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:45.809583 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.809546    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd" event={"ID":"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2","Type":"ContainerStarted","Data":"eb71a584bc65ec68b3de8f5c7f26844a41c5478a2109463104b38cf503621612"}
Jul 17 16:31:45.867254 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:45.867217    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:46.008009 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:46.007984    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-qwcng"]
Jul 17 16:31:46.010323 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:46.010291    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b0458d_a47b_49eb_9cb2_cf82def5c1a5.slice/crio-e7c399a89c3d3df6076e353a1fac90acc478a81632333265e14d2ad7010e6df8 WatchSource:0}: Error finding container e7c399a89c3d3df6076e353a1fac90acc478a81632333265e14d2ad7010e6df8: Status 404 returned error can't find the container with id e7c399a89c3d3df6076e353a1fac90acc478a81632333265e14d2ad7010e6df8
Jul 17 16:31:46.818687 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:46.818647    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng" event={"ID":"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5","Type":"ContainerStarted","Data":"e7c399a89c3d3df6076e353a1fac90acc478a81632333265e14d2ad7010e6df8"}
Jul 17 16:31:49.834704 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.834666    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd" event={"ID":"709d26af-cf5e-4fcf-a9a9-e00e69adb0d2","Type":"ContainerStarted","Data":"7af21209cf60cca803589403778e3b7bad90ed9dfd3e531554d3e563b8fbf249"}
Jul 17 16:31:49.835176 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.834790    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:31:49.836315 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.836286    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng" event={"ID":"c0b0458d-a47b-49eb-9cb2-cf82def5c1a5","Type":"ContainerStarted","Data":"4bae4b85731eaf533cb175d3849ad27edcf01e8ce60662e1e16b268bf0372e91"}
Jul 17 16:31:49.836556 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.836365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:31:49.853437 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.853361    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd" podStartSLOduration=2.561389427 podStartE2EDuration="5.853341596s" totalImagesPullingTime="3.291952169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:49.853207098 +0000 UTC m=+344.965749690" watchObservedRunningTime="2026-07-17 16:31:49.853341596 +0000 UTC m=+344.965884173"
Jul 17 16:31:49.869574 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:49.869520    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng" podStartSLOduration=3.105353959 podStartE2EDuration="5.869502226s" totalImagesPullingTime="2.764148267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:49.868114005 +0000 UTC m=+344.980656580" watchObservedRunningTime="2026-07-17 16:31:49.869502226 +0000 UTC m=+344.982044801"
Jul 17 16:31:54.179661 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.179623    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-schsq"]
Jul 17 16:31:54.182669 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.182645    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.185755 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.185737    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jszxt\""
Jul 17 16:31:54.186190 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.186177    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 17 16:31:54.197055 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.197022    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-schsq"]
Jul 17 16:31:54.200712 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.200686    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"]
Jul 17 16:31:54.209232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.209206    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.211706 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.211686    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 17 16:31:54.212526 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.212509    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lbj97\""
Jul 17 16:31:54.218448 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.218417    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"]
Jul 17 16:31:54.346925 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.346872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxh42\" (UniqueName: \"kubernetes.io/projected/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-kube-api-access-lxh42\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.346925 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.346932    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.347218 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.347034    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.347218 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.347072    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsj75\" (UniqueName: \"kubernetes.io/projected/63c706ca-87aa-481b-8086-00d5087d5576-kube-api-access-rsj75\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.448140 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.448021    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.448140 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.448076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsj75\" (UniqueName: \"kubernetes.io/projected/63c706ca-87aa-481b-8086-00d5087d5576-kube-api-access-rsj75\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.448140 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.448107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxh42\" (UniqueName: \"kubernetes.io/projected/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-kube-api-access-lxh42\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.448140 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.448151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.448439 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.448226    2558 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 17 16:31:54.448439 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.448239    2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 17 16:31:54.448439 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.448293    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert podName:abd6ad5f-1d55-41c6-b1d9-815d13a6d967 nodeName:}" failed. No retries permitted until 2026-07-17 16:31:54.948277869 +0000 UTC m=+350.060820426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert") pod "llmisvc-controller-manager-777c6bd7d5-fsx8h" (UID: "abd6ad5f-1d55-41c6-b1d9-815d13a6d967") : secret "llmisvc-webhook-server-cert" not found
Jul 17 16:31:54.448439 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.448305    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert podName:63c706ca-87aa-481b-8086-00d5087d5576 nodeName:}" failed. No retries permitted until 2026-07-17 16:31:54.948299612 +0000 UTC m=+350.060842166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert") pod "kserve-controller-manager-d6f4b65b8-schsq" (UID: "63c706ca-87aa-481b-8086-00d5087d5576") : secret "kserve-webhook-server-cert" not found
Jul 17 16:31:54.466583 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.466555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxh42\" (UniqueName: \"kubernetes.io/projected/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-kube-api-access-lxh42\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.466967 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.466946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsj75\" (UniqueName: \"kubernetes.io/projected/63c706ca-87aa-481b-8086-00d5087d5576-kube-api-access-rsj75\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.713908 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.713824    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"]
Jul 17 16:31:54.716995 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.716972    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.719562 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.719537    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 17 16:31:54.719686 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.719585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 17 16:31:54.720325 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.720301    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 16:31:54.720736 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.720717    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 16:31:54.720806 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.720717    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4mmj6\""
Jul 17 16:31:54.733653 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.733627    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"]
Jul 17 16:31:54.851254 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.851216    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4pb\" (UniqueName: \"kubernetes.io/projected/76707da4-bb9d-473f-92c3-73e73f0a3f14-kube-api-access-wx4pb\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.851446 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.851283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.851446 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.851347    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76707da4-bb9d-473f-92c3-73e73f0a3f14-tmp\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.952361 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.952328    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.952589 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.952384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.952589 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.952421    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76707da4-bb9d-473f-92c3-73e73f0a3f14-tmp\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.952589 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.952448    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.952589 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.952513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4pb\" (UniqueName: \"kubernetes.io/projected/76707da4-bb9d-473f-92c3-73e73f0a3f14-kube-api-access-wx4pb\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.952589 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.952528    2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 17 16:31:54.952806 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:31:54.952595    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs podName:76707da4-bb9d-473f-92c3-73e73f0a3f14 nodeName:}" failed. No retries permitted until 2026-07-17 16:31:55.452575269 +0000 UTC m=+350.565117826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs") pod "kube-auth-proxy-55b8db87d7-rljpt" (UID: "76707da4-bb9d-473f-92c3-73e73f0a3f14") : secret "kube-auth-proxy-tls" not found
Jul 17 16:31:54.954891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.954861    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76707da4-bb9d-473f-92c3-73e73f0a3f14-tmp\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:54.955006 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.954952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63c706ca-87aa-481b-8086-00d5087d5576-cert\") pod \"kserve-controller-manager-d6f4b65b8-schsq\" (UID: \"63c706ca-87aa-481b-8086-00d5087d5576\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:54.955118 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.955098    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abd6ad5f-1d55-41c6-b1d9-815d13a6d967-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-fsx8h\" (UID: \"abd6ad5f-1d55-41c6-b1d9-815d13a6d967\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:54.981790 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:54.981699    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4pb\" (UniqueName: \"kubernetes.io/projected/76707da4-bb9d-473f-92c3-73e73f0a3f14-kube-api-access-wx4pb\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:55.092653 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.092566    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:55.121343 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.121308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:55.238469 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.238427    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-schsq"]
Jul 17 16:31:55.240477 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:55.240439    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c706ca_87aa_481b_8086_00d5087d5576.slice/crio-3778e6f51a1a3cc2f0cd8f55288cbac579527cd81334957224e1018d7cb39bd1 WatchSource:0}: Error finding container 3778e6f51a1a3cc2f0cd8f55288cbac579527cd81334957224e1018d7cb39bd1: Status 404 returned error can't find the container with id 3778e6f51a1a3cc2f0cd8f55288cbac579527cd81334957224e1018d7cb39bd1
Jul 17 16:31:55.270436 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.270246    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"]
Jul 17 16:31:55.272639 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:55.272613    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podabd6ad5f_1d55_41c6_b1d9_815d13a6d967.slice/crio-9af0dfa9b5276444755ffecb779852dd36b6e465d02b3bc77a3f0e29392dd154 WatchSource:0}: Error finding container 9af0dfa9b5276444755ffecb779852dd36b6e465d02b3bc77a3f0e29392dd154: Status 404 returned error can't find the container with id 9af0dfa9b5276444755ffecb779852dd36b6e465d02b3bc77a3f0e29392dd154
Jul 17 16:31:55.456648 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.456606    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:55.459184 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.459154    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/76707da4-bb9d-473f-92c3-73e73f0a3f14-tls-certs\") pod \"kube-auth-proxy-55b8db87d7-rljpt\" (UID: \"76707da4-bb9d-473f-92c3-73e73f0a3f14\") " pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:55.627023 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.626930    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"
Jul 17 16:31:55.767113 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.767090    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt"]
Jul 17 16:31:55.769673 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:55.769647    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76707da4_bb9d_473f_92c3_73e73f0a3f14.slice/crio-81129ba3a1741d6a6e9ca84e7519484ce1788a80397c785df2bf63463d11b554 WatchSource:0}: Error finding container 81129ba3a1741d6a6e9ca84e7519484ce1788a80397c785df2bf63463d11b554: Status 404 returned error can't find the container with id 81129ba3a1741d6a6e9ca84e7519484ce1788a80397c785df2bf63463d11b554
Jul 17 16:31:55.864195 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.864159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h" event={"ID":"abd6ad5f-1d55-41c6-b1d9-815d13a6d967","Type":"ContainerStarted","Data":"9af0dfa9b5276444755ffecb779852dd36b6e465d02b3bc77a3f0e29392dd154"}
Jul 17 16:31:55.865676 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.865641    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt" event={"ID":"76707da4-bb9d-473f-92c3-73e73f0a3f14","Type":"ContainerStarted","Data":"81129ba3a1741d6a6e9ca84e7519484ce1788a80397c785df2bf63463d11b554"}
Jul 17 16:31:55.866986 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:55.866957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq" event={"ID":"63c706ca-87aa-481b-8086-00d5087d5576","Type":"ContainerStarted","Data":"3778e6f51a1a3cc2f0cd8f55288cbac579527cd81334957224e1018d7cb39bd1"}
Jul 17 16:31:57.131370 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.131327    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"]
Jul 17 16:31:57.140269 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.140234    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.143887 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.143855    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 17 16:31:57.143887 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.143879    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 17 16:31:57.144175 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.143864    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 17 16:31:57.144767 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.144699    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-c6ktx\""
Jul 17 16:31:57.144767 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.144769    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 16:31:57.158067 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.158037    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"]
Jul 17 16:31:57.274689 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274618    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.274891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274706    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.274891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274742    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.274891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.274891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274848    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4b8f90e-2751-441f-b06e-eb81dc50784c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.274891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274884    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.275169 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.274996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d84h7\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-kube-api-access-d84h7\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375619 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375579    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375803 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375638    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375803 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4b8f90e-2751-441f-b06e-eb81dc50784c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375803 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375803 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d84h7\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-kube-api-access-d84h7\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.375803 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.376069 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.375865    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.376733 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.376665    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.379367 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.379338    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.379499 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.379480    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4b8f90e-2751-441f-b06e-eb81dc50784c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.379564 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.379482    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.379829 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.379774    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.385843 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.385754    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.386039 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.386015    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d84h7\" (UniqueName: \"kubernetes.io/projected/f4b8f90e-2751-441f-b06e-eb81dc50784c-kube-api-access-d84h7\") pod \"istiod-openshift-gateway-94bb8fbfd-sjzh6\" (UID: \"f4b8f90e-2751-441f-b06e-eb81dc50784c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:57.452936 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:57.452893    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:31:59.129264 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.129238    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"]
Jul 17 16:31:59.131468 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:31:59.131445    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b8f90e_2751_441f_b06e_eb81dc50784c.slice/crio-c7548192e20bcf1a114444c3c1576f80f97e735812f90897bea6394feed1368a WatchSource:0}: Error finding container c7548192e20bcf1a114444c3c1576f80f97e735812f90897bea6394feed1368a: Status 404 returned error can't find the container with id c7548192e20bcf1a114444c3c1576f80f97e735812f90897bea6394feed1368a
Jul 17 16:31:59.892928 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.892887    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h" event={"ID":"abd6ad5f-1d55-41c6-b1d9-815d13a6d967","Type":"ContainerStarted","Data":"34028e63a14a25b741e644e9fb25c1a719c1516dc54ad3c39352fd4de25a709c"}
Jul 17 16:31:59.893447 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.893267    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:31:59.895289 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.895216    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt" event={"ID":"76707da4-bb9d-473f-92c3-73e73f0a3f14","Type":"ContainerStarted","Data":"b11dd74ae8c4378f41f0e99b488d90f4a3d04935524d085d52de78bb92af63a0"}
Jul 17 16:31:59.897342 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.897308    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq" event={"ID":"63c706ca-87aa-481b-8086-00d5087d5576","Type":"ContainerStarted","Data":"455bfeb6859f77f9a4629da7b5c2160c33e168dcc2907995ab00e7e6c974f942"}
Jul 17 16:31:59.897480 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.897376    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:31:59.899111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.899083    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6" event={"ID":"f4b8f90e-2751-441f-b06e-eb81dc50784c","Type":"ContainerStarted","Data":"c7548192e20bcf1a114444c3c1576f80f97e735812f90897bea6394feed1368a"}
Jul 17 16:31:59.912806 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.912752    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h" podStartSLOduration=2.21334295 podStartE2EDuration="5.912715674s" totalImagesPullingTime="3.699372724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:59.911761578 +0000 UTC m=+355.024304180" watchObservedRunningTime="2026-07-17 16:31:59.912715674 +0000 UTC m=+355.025258252"
Jul 17 16:31:59.930090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.930033    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq" podStartSLOduration=2.198805105 podStartE2EDuration="5.930016882s" totalImagesPullingTime="3.731211777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:59.929790651 +0000 UTC m=+355.042333229" watchObservedRunningTime="2026-07-17 16:31:59.930016882 +0000 UTC m=+355.042559469"
Jul 17 16:31:59.952145 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:31:59.952064    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55b8db87d7-rljpt" podStartSLOduration=2.739259058 podStartE2EDuration="5.952041525s" totalImagesPullingTime="3.212782467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:31:59.950076182 +0000 UTC m=+355.062618786" watchObservedRunningTime="2026-07-17 16:31:59.952041525 +0000 UTC m=+355.064584103"
Jul 17 16:32:00.843508 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:00.843466    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-pnsxd"
Jul 17 16:32:00.845682 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:00.845658    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-qwcng"
Jul 17 16:32:02.352111 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:02.352072    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 16:32:02.352444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:02.352167    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 17 16:32:02.920528 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:02.920485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6" event={"ID":"f4b8f90e-2751-441f-b06e-eb81dc50784c","Type":"ContainerStarted","Data":"9cf72d427c06cf9c07d6f54cff25941c211c5a80efb3d0526281095e62586e6c"}
Jul 17 16:32:02.920728 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:02.920587    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:32:02.951148 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:02.947384    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6" podStartSLOduration=2.729404206 podStartE2EDuration="5.947362989s" totalImagesPullingTime="3.217958783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:32:02.943262757 +0000 UTC m=+358.055805346" watchObservedRunningTime="2026-07-17 16:32:02.947362989 +0000 UTC m=+358.059905568"
Jul 17 16:32:03.926739 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:03.926710    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-sjzh6"
Jul 17 16:32:24.850053 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:32:24.849999    2558 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift/origin-insights-runtime-exporter:latest: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-insights-runtime-exporter:latest"
Jul 17 16:32:24.850537 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:32:24.850142    2558 kuberuntime_manager.go:1459] "Unhandled Error" err="container exporter start failed in pod insights-runtime-extractor-dw6d9_openshift-insights(800d8648-76c4-496d-80b6-ede3a10dceaf): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift/origin-insights-runtime-exporter:latest: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 16:32:30.641933 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:32:30.641895    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift/origin-insights-runtime-exporter:latest: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dw6d9" podUID="800d8648-76c4-496d-80b6-ede3a10dceaf"
Jul 17 16:32:30.907453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:30.907371    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-fsx8h"
Jul 17 16:32:30.910581 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:30.910560    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-schsq"
Jul 17 16:32:31.046369 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.046332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dw6d9" event={"ID":"800d8648-76c4-496d-80b6-ede3a10dceaf","Type":"ContainerStarted","Data":"a13ddf76c39dab92a241b61f72eab20f360e8106dad4701c67af366f0d072bac"}
Jul 17 16:32:31.048862 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.048842    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bxh6h\""
Jul 17 16:32:31.057247 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:32:31.057214    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift/origin-insights-runtime-exporter:latest: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dw6d9" podUID="800d8648-76c4-496d-80b6-ede3a10dceaf"
Jul 17 16:32:31.148422 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.148390    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 16:32:31.148422 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.148425    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 16:32:31.148620 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.148426    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 16:32:31.158816 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:31.158794    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 16:32:32.050776 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:32:32.050736    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift/origin-insights-runtime-exporter:latest\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift/origin-insights-runtime-exporter:latest: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-dw6d9" podUID="800d8648-76c4-496d-80b6-ede3a10dceaf"
Jul 17 16:32:44.102971 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:44.102929    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dw6d9" event={"ID":"800d8648-76c4-496d-80b6-ede3a10dceaf","Type":"ContainerStarted","Data":"eb33c7953d6456ce07d7443757fae730fa2ee42511a3ba7f4170f27e739d354a"}
Jul 17 16:32:44.123429 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:32:44.123376    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dw6d9" podStartSLOduration=17.119508403 podStartE2EDuration="6m3.123360353s" totalImagesPullingTime="5m46.00385195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 16:26:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 16:32:44.121776256 +0000 UTC m=+399.234318846" watchObservedRunningTime="2026-07-17 16:32:44.123360353 +0000 UTC m=+399.235902926"
Jul 17 16:33:18.429036 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.428991    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"]
Jul 17 16:33:18.453591 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.453554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"]
Jul 17 16:33:18.453759 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.453684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.456388 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.456357    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 16:33:18.456526 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.456512    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 16:33:18.456582 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.456558    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6kglj\""
Jul 17 16:33:18.527025 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.526980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.527251 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.527076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.527251 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.527118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szmgf\" (UniqueName: \"kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.627497 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.627457    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.627688 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.627516    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szmgf\" (UniqueName: \"kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.627688 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.627548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.627852 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.627830    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.627906 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.627855    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.636733 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.636704    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szmgf\" (UniqueName: \"kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.763409 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.763308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:18.824879 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.824830    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"]
Jul 17 16:33:18.827931 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.827906    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:18.836563 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.836528    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"]
Jul 17 16:33:18.904446 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.904421    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"]
Jul 17 16:33:18.906354 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:33:18.906328    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c431220_e2e4_4e03_9f8f_8eecead8e257.slice/crio-20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692 WatchSource:0}: Error finding container 20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692: Status 404 returned error can't find the container with id 20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692
Jul 17 16:33:18.929299 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.929272    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:18.929450 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.929341    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5bz2\" (UniqueName: \"kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:18.929450 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:18.929365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.029759 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.029723    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5bz2\" (UniqueName: \"kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.029759 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.029761    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.029957 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.029802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.030183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.030156    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.030316 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.030226    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.038599 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.038573    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5bz2\" (UniqueName: \"kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.142371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.142326    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:19.229456 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.229427    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"]
Jul 17 16:33:19.232180 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.232158    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.242515 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.242489    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"]
Jul 17 16:33:19.264430 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.264396    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerID="7defb03ce9572a5a535ab4bec3bb4e87ea55c2d797d74707f22413343b283021" exitCode=0
Jul 17 16:33:19.264571 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.264459    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr" event={"ID":"8c431220-e2e4-4e03-9f8f-8eecead8e257","Type":"ContainerDied","Data":"7defb03ce9572a5a535ab4bec3bb4e87ea55c2d797d74707f22413343b283021"}
Jul 17 16:33:19.264571 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.264502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr" event={"ID":"8c431220-e2e4-4e03-9f8f-8eecead8e257","Type":"ContainerStarted","Data":"20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692"}
Jul 17 16:33:19.284386 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.284364    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"]
Jul 17 16:33:19.286685 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:33:19.286659    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c877273_801b_4128_be70_38dc65ded920.slice/crio-e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0 WatchSource:0}: Error finding container e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0: Status 404 returned error can't find the container with id e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0
Jul 17 16:33:19.332108 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.332063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvhmh\" (UniqueName: \"kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.332108 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.332101    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.332339 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.332147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.433619 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.433580    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvhmh\" (UniqueName: \"kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.433619 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.433619    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.434017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.433644    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.434017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.433969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.434017 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.433992    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.442558 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.442526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvhmh\" (UniqueName: \"kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.543386 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.543294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:19.621724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.621685    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"]
Jul 17 16:33:19.624382 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.624356    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.634834 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.634803    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"]
Jul 17 16:33:19.681081 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.681053    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"]
Jul 17 16:33:19.683658 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:33:19.683630    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8d15d0_1f79_44e5_a1ff_ea9287961ed9.slice/crio-17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c WatchSource:0}: Error finding container 17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c: Status 404 returned error can't find the container with id 17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c
Jul 17 16:33:19.735809 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.735779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.735809 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.735811    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tftr\" (UniqueName: \"kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.735991 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.735883    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.836745 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.836702    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.836745 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.836745    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tftr\" (UniqueName: \"kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.837003 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.836802    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.837116 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.837094    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.837116 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.837112    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.845480 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.845461    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tftr\" (UniqueName: \"kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:19.938669 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:19.938629    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:20.190261 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.190110    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"]
Jul 17 16:33:20.235072 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:33:20.235031    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef62e96d_8150_4c6e_9da0_9952008a9079.slice/crio-e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c WatchSource:0}: Error finding container e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c: Status 404 returned error can't find the container with id e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c
Jul 17 16:33:20.272314 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.272280    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb" event={"ID":"ef62e96d-8150-4c6e-9da0-9952008a9079","Type":"ContainerStarted","Data":"e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c"}
Jul 17 16:33:20.274297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.274267    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerID="4e8fb96035eaca0e880d0cf8dd6201189a7df4df8e86905aaea5846deae962c2" exitCode=0
Jul 17 16:33:20.274419 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.274354    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr" event={"ID":"8c431220-e2e4-4e03-9f8f-8eecead8e257","Type":"ContainerDied","Data":"4e8fb96035eaca0e880d0cf8dd6201189a7df4df8e86905aaea5846deae962c2"}
Jul 17 16:33:20.276078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.276056    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c877273-801b-4128-be70-38dc65ded920" containerID="1b3fde93b55c94356673760424ba687ecab0276386146585448d4e2e8c38fb7f" exitCode=0
Jul 17 16:33:20.276212 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.276108    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55" event={"ID":"5c877273-801b-4128-be70-38dc65ded920","Type":"ContainerDied","Data":"1b3fde93b55c94356673760424ba687ecab0276386146585448d4e2e8c38fb7f"}
Jul 17 16:33:20.276212 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.276173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55" event={"ID":"5c877273-801b-4128-be70-38dc65ded920","Type":"ContainerStarted","Data":"e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0"}
Jul 17 16:33:20.277751 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.277731    2558 generic.go:356] "Generic (PLEG): container finished" podID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerID="9fc9c9e8a926c063f2d4d05a228aeeab16a806017b8121360d46af0928a09baa" exitCode=0
Jul 17 16:33:20.277891 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.277763    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk" event={"ID":"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9","Type":"ContainerDied","Data":"9fc9c9e8a926c063f2d4d05a228aeeab16a806017b8121360d46af0928a09baa"}
Jul 17 16:33:20.277994 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:20.277913    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk" event={"ID":"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9","Type":"ContainerStarted","Data":"17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c"}
Jul 17 16:33:21.285657 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.285624    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerID="c80564a3d3e84df161eb8bdc5f2bcebff102091659c11caa8bee49cc553e6885" exitCode=0
Jul 17 16:33:21.286028 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.285719    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb" event={"ID":"ef62e96d-8150-4c6e-9da0-9952008a9079","Type":"ContainerDied","Data":"c80564a3d3e84df161eb8bdc5f2bcebff102091659c11caa8bee49cc553e6885"}
Jul 17 16:33:21.288434 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.288381    2558 generic.go:356] "Generic (PLEG): container finished" podID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerID="b4706737fb902e76edc2a930073a608483616fc7aeda29ccd67fc2df4110f737" exitCode=0
Jul 17 16:33:21.288505 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.288473    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr" event={"ID":"8c431220-e2e4-4e03-9f8f-8eecead8e257","Type":"ContainerDied","Data":"b4706737fb902e76edc2a930073a608483616fc7aeda29ccd67fc2df4110f737"}
Jul 17 16:33:21.290506 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.290485    2558 generic.go:356] "Generic (PLEG): container finished" podID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerID="905bf10eaf6c6daeb3033a7d64efb818e5c135fc45e7e7f4416efe7314414316" exitCode=0
Jul 17 16:33:21.290584 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:21.290555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk" event={"ID":"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9","Type":"ContainerDied","Data":"905bf10eaf6c6daeb3033a7d64efb818e5c135fc45e7e7f4416efe7314414316"}
Jul 17 16:33:22.301996 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.301960    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerID="ae6b20696dfcb625d759929a57f00b1dbf2468ffeb7aa090763e4cf8993defcf" exitCode=0
Jul 17 16:33:22.302441 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.302043    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb" event={"ID":"ef62e96d-8150-4c6e-9da0-9952008a9079","Type":"ContainerDied","Data":"ae6b20696dfcb625d759929a57f00b1dbf2468ffeb7aa090763e4cf8993defcf"}
Jul 17 16:33:22.303950 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.303920    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c877273-801b-4128-be70-38dc65ded920" containerID="1941fa7e1cd2a1688c60e4ae8aa57f5dc3ffbd669af73a1690009c6616b46b08" exitCode=0
Jul 17 16:33:22.304051 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.304001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55" event={"ID":"5c877273-801b-4128-be70-38dc65ded920","Type":"ContainerDied","Data":"1941fa7e1cd2a1688c60e4ae8aa57f5dc3ffbd669af73a1690009c6616b46b08"}
Jul 17 16:33:22.306228 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.306205    2558 generic.go:356] "Generic (PLEG): container finished" podID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerID="31313b8ed17948237a872ec419fe3dc3e9521db5eaf24ea94c978bb77fc00ebf" exitCode=0
Jul 17 16:33:22.306322 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.306275    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk" event={"ID":"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9","Type":"ContainerDied","Data":"31313b8ed17948237a872ec419fe3dc3e9521db5eaf24ea94c978bb77fc00ebf"}
Jul 17 16:33:22.443885 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.443851    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:22.559350 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.559313    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle\") pod \"8c431220-e2e4-4e03-9f8f-8eecead8e257\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") "
Jul 17 16:33:22.559350 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.559356    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util\") pod \"8c431220-e2e4-4e03-9f8f-8eecead8e257\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") "
Jul 17 16:33:22.559576 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.559422    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szmgf\" (UniqueName: \"kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf\") pod \"8c431220-e2e4-4e03-9f8f-8eecead8e257\" (UID: \"8c431220-e2e4-4e03-9f8f-8eecead8e257\") "
Jul 17 16:33:22.559968 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.559925    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle" (OuterVolumeSpecName: "bundle") pod "8c431220-e2e4-4e03-9f8f-8eecead8e257" (UID: "8c431220-e2e4-4e03-9f8f-8eecead8e257"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:22.561769 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.561746    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf" (OuterVolumeSpecName: "kube-api-access-szmgf") pod "8c431220-e2e4-4e03-9f8f-8eecead8e257" (UID: "8c431220-e2e4-4e03-9f8f-8eecead8e257"). InnerVolumeSpecName "kube-api-access-szmgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:33:22.565524 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.565502    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util" (OuterVolumeSpecName: "util") pod "8c431220-e2e4-4e03-9f8f-8eecead8e257" (UID: "8c431220-e2e4-4e03-9f8f-8eecead8e257"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:22.660534 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.660493    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:22.660534 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.660527    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8c431220-e2e4-4e03-9f8f-8eecead8e257-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:22.660534 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:22.660536    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szmgf\" (UniqueName: \"kubernetes.io/projected/8c431220-e2e4-4e03-9f8f-8eecead8e257-kube-api-access-szmgf\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:23.312793 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.312760    2558 generic.go:356] "Generic (PLEG): container finished" podID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerID="712ae9eadf371e2a75c88ea3f13c149234d47999c4eb48cdce885ef13227520c" exitCode=0
Jul 17 16:33:23.313299 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.312853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb" event={"ID":"ef62e96d-8150-4c6e-9da0-9952008a9079","Type":"ContainerDied","Data":"712ae9eadf371e2a75c88ea3f13c149234d47999c4eb48cdce885ef13227520c"}
Jul 17 16:33:23.314651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.314631    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr"
Jul 17 16:33:23.314651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.314636    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr" event={"ID":"8c431220-e2e4-4e03-9f8f-8eecead8e257","Type":"ContainerDied","Data":"20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692"}
Jul 17 16:33:23.314776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.314685    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20bfd73557455a218a90668389819285a64a1c3d0efd1e713ba5b6ed49d6d692"
Jul 17 16:33:23.316776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.316751    2558 generic.go:356] "Generic (PLEG): container finished" podID="5c877273-801b-4128-be70-38dc65ded920" containerID="43ca880e94199dfa5a20356407742dfe56c795504247ff375a78eb5427b82f49" exitCode=0
Jul 17 16:33:23.316918 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.316841    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55" event={"ID":"5c877273-801b-4128-be70-38dc65ded920","Type":"ContainerDied","Data":"43ca880e94199dfa5a20356407742dfe56c795504247ff375a78eb5427b82f49"}
Jul 17 16:33:23.446202 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.446167    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:23.466396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.466360    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util\") pod \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") "
Jul 17 16:33:23.466528 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.466421    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle\") pod \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") "
Jul 17 16:33:23.466528 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.466469    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvhmh\" (UniqueName: \"kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh\") pod \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\" (UID: \"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9\") "
Jul 17 16:33:23.466954 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.466920    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle" (OuterVolumeSpecName: "bundle") pod "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" (UID: "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:23.469414 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.469383    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh" (OuterVolumeSpecName: "kube-api-access-gvhmh") pod "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" (UID: "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9"). InnerVolumeSpecName "kube-api-access-gvhmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:33:23.472765 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.472738    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util" (OuterVolumeSpecName: "util") pod "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" (UID: "eb8d15d0-1f79-44e5-a1ff-ea9287961ed9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:23.567319 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.567172    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:23.567319 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.567254    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:23.567319 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:23.567265    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvhmh\" (UniqueName: \"kubernetes.io/projected/eb8d15d0-1f79-44e5-a1ff-ea9287961ed9-kube-api-access-gvhmh\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.323834 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.323789    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk" event={"ID":"eb8d15d0-1f79-44e5-a1ff-ea9287961ed9","Type":"ContainerDied","Data":"17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c"}
Jul 17 16:33:24.323834 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.323818    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk"
Jul 17 16:33:24.323834 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.323843    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17a9cfa4616dc28ca098de1f41911e6e2c67a9b5f96be2d103d1d735fd68646c"
Jul 17 16:33:24.478866 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.478842    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:24.480888 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.480861    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:24.575496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util\") pod \"5c877273-801b-4128-be70-38dc65ded920\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") "
Jul 17 16:33:24.575496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575465    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle\") pod \"ef62e96d-8150-4c6e-9da0-9952008a9079\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") "
Jul 17 16:33:24.575496 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575490    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util\") pod \"ef62e96d-8150-4c6e-9da0-9952008a9079\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") "
Jul 17 16:33:24.575778 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575518    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle\") pod \"5c877273-801b-4128-be70-38dc65ded920\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") "
Jul 17 16:33:24.575778 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575541    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tftr\" (UniqueName: \"kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr\") pod \"ef62e96d-8150-4c6e-9da0-9952008a9079\" (UID: \"ef62e96d-8150-4c6e-9da0-9952008a9079\") "
Jul 17 16:33:24.575778 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.575579    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5bz2\" (UniqueName: \"kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2\") pod \"5c877273-801b-4128-be70-38dc65ded920\" (UID: \"5c877273-801b-4128-be70-38dc65ded920\") "
Jul 17 16:33:24.576104 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.576076    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle" (OuterVolumeSpecName: "bundle") pod "5c877273-801b-4128-be70-38dc65ded920" (UID: "5c877273-801b-4128-be70-38dc65ded920"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:24.576198 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.576177    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle" (OuterVolumeSpecName: "bundle") pod "ef62e96d-8150-4c6e-9da0-9952008a9079" (UID: "ef62e96d-8150-4c6e-9da0-9952008a9079"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:24.578329 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.578309    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr" (OuterVolumeSpecName: "kube-api-access-6tftr") pod "ef62e96d-8150-4c6e-9da0-9952008a9079" (UID: "ef62e96d-8150-4c6e-9da0-9952008a9079"). InnerVolumeSpecName "kube-api-access-6tftr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:33:24.578329 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.578319    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2" (OuterVolumeSpecName: "kube-api-access-x5bz2") pod "5c877273-801b-4128-be70-38dc65ded920" (UID: "5c877273-801b-4128-be70-38dc65ded920"). InnerVolumeSpecName "kube-api-access-x5bz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:33:24.581450 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.581399    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util" (OuterVolumeSpecName: "util") pod "ef62e96d-8150-4c6e-9da0-9952008a9079" (UID: "ef62e96d-8150-4c6e-9da0-9952008a9079"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:24.583390 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.583366    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util" (OuterVolumeSpecName: "util") pod "5c877273-801b-4128-be70-38dc65ded920" (UID: "5c877273-801b-4128-be70-38dc65ded920"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 16:33:24.676077 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676041    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.676077 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676069    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.676077 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676079    2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef62e96d-8150-4c6e-9da0-9952008a9079-util\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.676077 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676087    2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c877273-801b-4128-be70-38dc65ded920-bundle\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.676337 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676096    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tftr\" (UniqueName: \"kubernetes.io/projected/ef62e96d-8150-4c6e-9da0-9952008a9079-kube-api-access-6tftr\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:24.676337 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:24.676104    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5bz2\" (UniqueName: \"kubernetes.io/projected/5c877273-801b-4128-be70-38dc65ded920-kube-api-access-x5bz2\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:33:25.330780 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.330701    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb"
Jul 17 16:33:25.330780 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.330729    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb" event={"ID":"ef62e96d-8150-4c6e-9da0-9952008a9079","Type":"ContainerDied","Data":"e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c"}
Jul 17 16:33:25.330780 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.330778    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8ef956498d14811cd9861d4cd91c379ba3a178f33bde07b21fb9863011f953c"
Jul 17 16:33:25.332776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.332754    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55"
Jul 17 16:33:25.332776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.332764    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55" event={"ID":"5c877273-801b-4128-be70-38dc65ded920","Type":"ContainerDied","Data":"e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0"}
Jul 17 16:33:25.332925 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:25.332806    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e664e2ffba7ffbfe3d9968c4915ab715b8d9af774009f511d445967e555782f0"
Jul 17 16:33:41.641312 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641273    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"]
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641567    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641578    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641589    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="pull"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641593    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="pull"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641601    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="extract"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641606    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="extract"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641614    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="extract"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641619    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="extract"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641629    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641635    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641641    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="pull"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641646    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="pull"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641654    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641658    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="util"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641666    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="pull"
Jul 17 16:33:41.641665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641670    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="pull"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641677    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641682    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641688    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="util"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641692    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="util"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641698    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="pull"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641703    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="pull"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641708    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641714    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641757    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef62e96d-8150-4c6e-9da0-9952008a9079" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641764    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c877273-801b-4128-be70-38dc65ded920" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641769    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c431220-e2e4-4e03-9f8f-8eecead8e257" containerName="extract"
Jul 17 16:33:41.642149 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.641776    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb8d15d0-1f79-44e5-a1ff-ea9287961ed9" containerName="extract"
Jul 17 16:33:41.644469 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.644453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:41.648735 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.648706    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 16:33:41.648873 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.648813    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-t7pdj\""
Jul 17 16:33:41.651564 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.651540    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 16:33:41.668893 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.668857    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"]
Jul 17 16:33:41.715167 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.715111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vsk\" (UniqueName: \"kubernetes.io/projected/f7f07752-854e-4e41-827d-624c25f50d08-kube-api-access-q2vsk\") pod \"authorino-operator-75cc8d5cb7-pzvhb\" (UID: \"f7f07752-854e-4e41-827d-624c25f50d08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:41.815794 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.815750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vsk\" (UniqueName: \"kubernetes.io/projected/f7f07752-854e-4e41-827d-624c25f50d08-kube-api-access-q2vsk\") pod \"authorino-operator-75cc8d5cb7-pzvhb\" (UID: \"f7f07752-854e-4e41-827d-624c25f50d08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:41.827620 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.827586    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vsk\" (UniqueName: \"kubernetes.io/projected/f7f07752-854e-4e41-827d-624c25f50d08-kube-api-access-q2vsk\") pod \"authorino-operator-75cc8d5cb7-pzvhb\" (UID: \"f7f07752-854e-4e41-827d-624c25f50d08\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:41.954822 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:41.954785    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:42.089904 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:42.089880    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"]
Jul 17 16:33:42.092640 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:33:42.092613    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7f07752_854e_4e41_827d_624c25f50d08.slice/crio-fbfb13ffa59331ace20f06d009594e567b1584d20f4fe162a2a5710d5d092a92 WatchSource:0}: Error finding container fbfb13ffa59331ace20f06d009594e567b1584d20f4fe162a2a5710d5d092a92: Status 404 returned error can't find the container with id fbfb13ffa59331ace20f06d009594e567b1584d20f4fe162a2a5710d5d092a92
Jul 17 16:33:42.411657 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:42.411630    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb" event={"ID":"f7f07752-854e-4e41-827d-624c25f50d08","Type":"ContainerStarted","Data":"fbfb13ffa59331ace20f06d009594e567b1584d20f4fe162a2a5710d5d092a92"}
Jul 17 16:33:45.435791 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:45.435746    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb" event={"ID":"f7f07752-854e-4e41-827d-624c25f50d08","Type":"ContainerStarted","Data":"926094f6b4b8ae5033b965b697ed7ee9efaaa83ef5bfa01f8a0190fb02561278"}
Jul 17 16:33:45.436264 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:45.435820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:33:45.461973 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:45.461916    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb" podStartSLOduration=1.877691172 podStartE2EDuration="4.461900013s" totalImagesPullingTime="2.584208841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:33:45.460776673 +0000 UTC m=+460.573319249" watchObservedRunningTime="2026-07-17 16:33:45.461900013 +0000 UTC m=+460.574442588"
Jul 17 16:33:56.443151 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:33:56.443092    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-pzvhb"
Jul 17 16:34:54.601451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.601417    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:34:54.604840 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.604819    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.607250 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.607211    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 16:34:54.607382 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.607263    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6kglj\""
Jul 17 16:34:54.616761 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.616738    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:34:54.702212 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.702173    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:34:54.716430 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.716395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.716585 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.716503    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp75c\" (UniqueName: \"kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.817227 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.817189    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp75c\" (UniqueName: \"kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.817403 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.817287    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.817929 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.817909    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.835014 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.834980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp75c\" (UniqueName: \"kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c\") pod \"limitador-limitador-64c94fd64f-xltqj\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:54.915010 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:54.914976    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:55.064689 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:55.064605    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:34:55.068341 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:34:55.068311    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82d3d276_5e75_4296_801e_c9da233cba7e.slice/crio-bc30926ab0ed01b53c4e46e3b8f57357627328cc36bc26918094295859056f2b WatchSource:0}: Error finding container bc30926ab0ed01b53c4e46e3b8f57357627328cc36bc26918094295859056f2b: Status 404 returned error can't find the container with id bc30926ab0ed01b53c4e46e3b8f57357627328cc36bc26918094295859056f2b
Jul 17 16:34:55.769665 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:55.769623    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" event={"ID":"82d3d276-5e75-4296-801e-c9da233cba7e","Type":"ContainerStarted","Data":"bc30926ab0ed01b53c4e46e3b8f57357627328cc36bc26918094295859056f2b"}
Jul 17 16:34:58.786314 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:58.786274    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" event={"ID":"82d3d276-5e75-4296-801e-c9da233cba7e","Type":"ContainerStarted","Data":"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"}
Jul 17 16:34:58.786714 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:58.786410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:34:58.804021 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:34:58.803963    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" podStartSLOduration=2.13168055 podStartE2EDuration="4.803944905s" totalImagesPullingTime="2.672264355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:34:58.803110455 +0000 UTC m=+533.915653066" watchObservedRunningTime="2026-07-17 16:34:58.803944905 +0000 UTC m=+533.916487481"
Jul 17 16:35:09.792164 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:09.792106    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:35:11.914716 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:11.914676    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:35:11.915183 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:11.914889    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" podUID="82d3d276-5e75-4296-801e-c9da233cba7e" containerName="limitador" containerID="cri-o://7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a" gracePeriod=30
Jul 17 16:35:12.458350 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.458325    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:35:12.459331 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.459308    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file\") pod \"82d3d276-5e75-4296-801e-c9da233cba7e\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") "
Jul 17 16:35:12.459447 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.459364    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp75c\" (UniqueName: \"kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c\") pod \"82d3d276-5e75-4296-801e-c9da233cba7e\" (UID: \"82d3d276-5e75-4296-801e-c9da233cba7e\") "
Jul 17 16:35:12.459686 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.459665    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file" (OuterVolumeSpecName: "config-file") pod "82d3d276-5e75-4296-801e-c9da233cba7e" (UID: "82d3d276-5e75-4296-801e-c9da233cba7e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 16:35:12.461551 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.461505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c" (OuterVolumeSpecName: "kube-api-access-bp75c") pod "82d3d276-5e75-4296-801e-c9da233cba7e" (UID: "82d3d276-5e75-4296-801e-c9da233cba7e"). InnerVolumeSpecName "kube-api-access-bp75c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:35:12.560101 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.560012    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp75c\" (UniqueName: \"kubernetes.io/projected/82d3d276-5e75-4296-801e-c9da233cba7e-kube-api-access-bp75c\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:35:12.560101 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.560046    2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/82d3d276-5e75-4296-801e-c9da233cba7e-config-file\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:35:12.855794 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.855704    2558 generic.go:356] "Generic (PLEG): container finished" podID="82d3d276-5e75-4296-801e-c9da233cba7e" containerID="7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a" exitCode=0
Jul 17 16:35:12.855794 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.855748    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj"
Jul 17 16:35:12.856012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.855794    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" event={"ID":"82d3d276-5e75-4296-801e-c9da233cba7e","Type":"ContainerDied","Data":"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"}
Jul 17 16:35:12.856012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.855843    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xltqj" event={"ID":"82d3d276-5e75-4296-801e-c9da233cba7e","Type":"ContainerDied","Data":"bc30926ab0ed01b53c4e46e3b8f57357627328cc36bc26918094295859056f2b"}
Jul 17 16:35:12.856012 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.855874    2558 scope.go:117] "RemoveContainer" containerID="7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"
Jul 17 16:35:12.865073 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.865053    2558 scope.go:117] "RemoveContainer" containerID="7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"
Jul 17 16:35:12.865419 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:35:12.865398    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a\": container with ID starting with 7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a not found: ID does not exist" containerID="7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"
Jul 17 16:35:12.865507 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.865427    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a"} err="failed to get container status \"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a\": rpc error: code = NotFound desc = could not find container \"7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a\": container with ID starting with 7b5a27e3e642c2af37ad589c70c87881f66235e2a78d2fcc6d83e53cce3c369a not found: ID does not exist"
Jul 17 16:35:12.877060 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.877029    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:35:12.880880 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:12.880851    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xltqj"]
Jul 17 16:35:13.414583 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:13.414548    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82d3d276-5e75-4296-801e-c9da233cba7e" path="/var/lib/kubelet/pods/82d3d276-5e75-4296-801e-c9da233cba7e/volumes"
Jul 17 16:35:16.172705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.172637    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"]
Jul 17 16:35:16.173280 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.173087    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82d3d276-5e75-4296-801e-c9da233cba7e" containerName="limitador"
Jul 17 16:35:16.173280 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.173105    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="82d3d276-5e75-4296-801e-c9da233cba7e" containerName="limitador"
Jul 17 16:35:16.173280 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.173203    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="82d3d276-5e75-4296-801e-c9da233cba7e" containerName="limitador"
Jul 17 16:35:16.177488 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.177468    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.179983 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.179961    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ss2gj\""
Jul 17 16:35:16.180113 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.180000    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 16:35:16.180776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.180759    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 16:35:16.180864 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.180821    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 16:35:16.186989 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.186964    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"]
Jul 17 16:35:16.187494 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.187470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bskqg\" (UniqueName: \"kubernetes.io/projected/cc60842d-8ec6-424a-850f-17558b161c2c-kube-api-access-bskqg\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.187587 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.187550    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc60842d-8ec6-424a-850f-17558b161c2c-data\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.288113 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.288071    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc60842d-8ec6-424a-850f-17558b161c2c-data\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.288297 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.288171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bskqg\" (UniqueName: \"kubernetes.io/projected/cc60842d-8ec6-424a-850f-17558b161c2c-kube-api-access-bskqg\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.288436 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.288415    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cc60842d-8ec6-424a-850f-17558b161c2c-data\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.296513 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.296481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bskqg\" (UniqueName: \"kubernetes.io/projected/cc60842d-8ec6-424a-850f-17558b161c2c-kube-api-access-bskqg\") pod \"postgres-69fb4594cf-q58l7\" (UID: \"cc60842d-8ec6-424a-850f-17558b161c2c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.487795 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.487706    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:16.622003 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.621975    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"]
Jul 17 16:35:16.623847 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:35:16.623815    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc60842d_8ec6_424a_850f_17558b161c2c.slice/crio-9d874e8f772f71acdd1d858f5c5981bf7532e8ce90fcf949a9de5e3527f95f6a WatchSource:0}: Error finding container 9d874e8f772f71acdd1d858f5c5981bf7532e8ce90fcf949a9de5e3527f95f6a: Status 404 returned error can't find the container with id 9d874e8f772f71acdd1d858f5c5981bf7532e8ce90fcf949a9de5e3527f95f6a
Jul 17 16:35:16.878782 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:16.878689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7" event={"ID":"cc60842d-8ec6-424a-850f-17558b161c2c","Type":"ContainerStarted","Data":"9d874e8f772f71acdd1d858f5c5981bf7532e8ce90fcf949a9de5e3527f95f6a"}
Jul 17 16:35:21.909568 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:21.909528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7" event={"ID":"cc60842d-8ec6-424a-850f-17558b161c2c","Type":"ContainerStarted","Data":"453537eb302a28d57aa2afce92b3ceb2a25c2100c739e22027fb85fce0e43650"}
Jul 17 16:35:21.909972 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:21.909656    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:21.928243 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:21.928143    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7" podStartSLOduration=0.877451092 podStartE2EDuration="5.928113535s" totalImagesPullingTime="5.050662443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:35:21.92641292 +0000 UTC m=+557.038955508" watchObservedRunningTime="2026-07-17 16:35:21.928113535 +0000 UTC m=+557.040656111"
Jul 17 16:35:27.945767 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:27.945733    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-q58l7"
Jul 17 16:35:34.599606 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.599570    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:34.619923 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.619886    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:34.620098 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.620016    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.622663 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.622636    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 16:35:34.623400 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.623375    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 16:35:34.623571 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.623382    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rwhw5\""
Jul 17 16:35:34.727786 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.727748    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.727786 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.727787    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wshw\" (UniqueName: \"kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.776338 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.776300    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:35:34.778739 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.778723    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.788145 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.788100    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:35:34.828943 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.828903    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbngn\" (UniqueName: \"kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.829112 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.828959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.829112 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.829006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wshw\" (UniqueName: \"kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.829112 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.829059    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.831628 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.831594    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.840229 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.840206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wshw\" (UniqueName: \"kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw\") pod \"maas-controller-5d5b57cfd6-7zgqx\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") " pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.930174 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.930117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbngn\" (UniqueName: \"kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.930366 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.930233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.930787 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.930763    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:34.933320 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.932913    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:34.938705 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:34.938680    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbngn\" (UniqueName: \"kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn\") pod \"maas-controller-66fdc48964-lbp4d\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") " pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:35.064779 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:35.064750    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:35.066958 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:35:35.066933    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf941bb_9331_4fc1_a822_9ec23d3371d9.slice/crio-2867bc081b6e24ab05f49a334a75fbce2a4de9b5b877d0b5d767a71125ba215c WatchSource:0}: Error finding container 2867bc081b6e24ab05f49a334a75fbce2a4de9b5b877d0b5d767a71125ba215c: Status 404 returned error can't find the container with id 2867bc081b6e24ab05f49a334a75fbce2a4de9b5b877d0b5d767a71125ba215c
Jul 17 16:35:35.090254 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:35.090224    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:35.224165 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:35.224137    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:35:35.225870 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:35:35.225846    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d570c1_db49_487d_b6d0_0246fe23aa92.slice/crio-6f312bb49efe5cdc8f77e2089083158b99906f328d37df5630062b41c304ed9e WatchSource:0}: Error finding container 6f312bb49efe5cdc8f77e2089083158b99906f328d37df5630062b41c304ed9e: Status 404 returned error can't find the container with id 6f312bb49efe5cdc8f77e2089083158b99906f328d37df5630062b41c304ed9e
Jul 17 16:35:35.984144 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:35.984030    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-lbp4d" event={"ID":"e6d570c1-db49-487d-b6d0-0246fe23aa92","Type":"ContainerStarted","Data":"6f312bb49efe5cdc8f77e2089083158b99906f328d37df5630062b41c304ed9e"}
Jul 17 16:35:35.986458 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:35.986366    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" event={"ID":"9bf941bb-9331-4fc1-a822-9ec23d3371d9","Type":"ContainerStarted","Data":"2867bc081b6e24ab05f49a334a75fbce2a4de9b5b877d0b5d767a71125ba215c"}
Jul 17 16:35:37.998984 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:37.998946    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" event={"ID":"9bf941bb-9331-4fc1-a822-9ec23d3371d9","Type":"ContainerStarted","Data":"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"}
Jul 17 16:35:37.999423 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:37.999155    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:38.000880 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:38.000847    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-lbp4d" event={"ID":"e6d570c1-db49-487d-b6d0-0246fe23aa92","Type":"ContainerStarted","Data":"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"}
Jul 17 16:35:38.001025 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:38.000989    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:38.021770 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:38.021716    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" podStartSLOduration=1.303352266 podStartE2EDuration="4.021697426s" totalImagesPullingTime="2.71834516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:35:38.020232299 +0000 UTC m=+573.132774895" watchObservedRunningTime="2026-07-17 16:35:38.021697426 +0000 UTC m=+573.134240002"
Jul 17 16:35:38.044849 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:38.044715    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66fdc48964-lbp4d" podStartSLOduration=1.481135471 podStartE2EDuration="4.044693317s" totalImagesPullingTime="2.563557846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:35:38.044571248 +0000 UTC m=+573.157113844" watchObservedRunningTime="2026-07-17 16:35:38.044693317 +0000 UTC m=+573.157235896"
Jul 17 16:35:49.008505 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.008473    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:49.009190 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.008543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:35:49.070193 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.070148    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:49.070390 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.070346    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" podUID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" containerName="manager" containerID="cri-o://3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf" gracePeriod=30
Jul 17 16:35:49.322575 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.322542    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:49.455360 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.455329    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert\") pod \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") "
Jul 17 16:35:49.455538 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.455406    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wshw\" (UniqueName: \"kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw\") pod \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\" (UID: \"9bf941bb-9331-4fc1-a822-9ec23d3371d9\") "
Jul 17 16:35:49.457875 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.457836    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9bf941bb-9331-4fc1-a822-9ec23d3371d9" (UID: "9bf941bb-9331-4fc1-a822-9ec23d3371d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:35:49.457875 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.457838    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw" (OuterVolumeSpecName: "kube-api-access-7wshw") pod "9bf941bb-9331-4fc1-a822-9ec23d3371d9" (UID: "9bf941bb-9331-4fc1-a822-9ec23d3371d9"). InnerVolumeSpecName "kube-api-access-7wshw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:35:49.556261 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.556170    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wshw\" (UniqueName: \"kubernetes.io/projected/9bf941bb-9331-4fc1-a822-9ec23d3371d9-kube-api-access-7wshw\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:35:49.556261 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:49.556201    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9bf941bb-9331-4fc1-a822-9ec23d3371d9-webhook-cert\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:35:50.061250 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.061211    2558 generic.go:356] "Generic (PLEG): container finished" podID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" containerID="3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf" exitCode=0
Jul 17 16:35:50.061645 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.061260    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx"
Jul 17 16:35:50.061645 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.061293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" event={"ID":"9bf941bb-9331-4fc1-a822-9ec23d3371d9","Type":"ContainerDied","Data":"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"}
Jul 17 16:35:50.061645 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.061349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5b57cfd6-7zgqx" event={"ID":"9bf941bb-9331-4fc1-a822-9ec23d3371d9","Type":"ContainerDied","Data":"2867bc081b6e24ab05f49a334a75fbce2a4de9b5b877d0b5d767a71125ba215c"}
Jul 17 16:35:50.061645 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.061373    2558 scope.go:117] "RemoveContainer" containerID="3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"
Jul 17 16:35:50.070320 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.070302    2558 scope.go:117] "RemoveContainer" containerID="3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"
Jul 17 16:35:50.070609 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:35:50.070589    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf\": container with ID starting with 3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf not found: ID does not exist" containerID="3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"
Jul 17 16:35:50.070670 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.070619    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf"} err="failed to get container status \"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf\": rpc error: code = NotFound desc = could not find container \"3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf\": container with ID starting with 3eee972219ae881fcfcf1e2deee22ea268a6a82d09d7974ac24c235b37dd31cf not found: ID does not exist"
Jul 17 16:35:50.082059 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.082025    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:50.086460 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:50.086427    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d5b57cfd6-7zgqx"]
Jul 17 16:35:51.413778 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:35:51.413736    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" path="/var/lib/kubelet/pods/9bf941bb-9331-4fc1-a822-9ec23d3371d9/volumes"
Jul 17 16:36:05.324610 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:05.324581    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:36:05.326529 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:05.326505    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:36:10.193381 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.193348    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"]
Jul 17 16:36:10.195840 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.193708    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" containerName="manager"
Jul 17 16:36:10.195840 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.193720    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" containerName="manager"
Jul 17 16:36:10.195840 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.193771    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf941bb-9331-4fc1-a822-9ec23d3371d9" containerName="manager"
Jul 17 16:36:10.196709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.196694    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.200334 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.200313    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 16:36:10.208140 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.208097    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"]
Jul 17 16:36:10.320346 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.320311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.320523 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.320361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7b6a94-2644-427e-b115-224bd19eced1-openshift-service-ca\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.320523 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.320388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lrgp\" (UniqueName: \"kubernetes.io/projected/3b7b6a94-2644-427e-b115-224bd19eced1-kube-api-access-4lrgp\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.421156 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.421106    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.421347 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.421195    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7b6a94-2644-427e-b115-224bd19eced1-openshift-service-ca\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.421347 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.421234    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lrgp\" (UniqueName: \"kubernetes.io/projected/3b7b6a94-2644-427e-b115-224bd19eced1-kube-api-access-4lrgp\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.421347 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:36:10.421268    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 17 16:36:10.421347 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:36:10.421341    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls podName:3b7b6a94-2644-427e-b115-224bd19eced1 nodeName:}" failed. No retries permitted until 2026-07-17 16:36:10.921320069 +0000 UTC m=+606.033862624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls") pod "maas-api-795f6f67d-qjglm" (UID: "3b7b6a94-2644-427e-b115-224bd19eced1") : secret "maas-api-serving-cert" not found
Jul 17 16:36:10.421807 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.421785    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b7b6a94-2644-427e-b115-224bd19eced1-openshift-service-ca\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.432993 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.432959    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lrgp\" (UniqueName: \"kubernetes.io/projected/3b7b6a94-2644-427e-b115-224bd19eced1-kube-api-access-4lrgp\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.781475 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.781436    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2rrvv"]
Jul 17 16:36:10.784857 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.784838    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:10.787016 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.786999    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 16:36:10.795102 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.795079    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2rrvv"]
Jul 17 16:36:10.857004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.856973    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bfk76"]
Jul 17 16:36:10.860233 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.860208    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:10.862764 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.862743    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6bxn5\""
Jul 17 16:36:10.872056 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.872030    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bfk76"]
Jul 17 16:36:10.925473 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.925434    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c06e839-75fc-44a0-912a-5910be30e1c9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:10.925667 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.925521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4d8z\" (UniqueName: \"kubernetes.io/projected/0c06e839-75fc-44a0-912a-5910be30e1c9-kube-api-access-t4d8z\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:10.925667 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.925584    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:10.925777 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.925669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:10.925777 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:10.925723    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b64mp\" (UniqueName: \"kubernetes.io/projected/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-kube-api-access-b64mp\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:10.925897 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:36:10.925873    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 17 16:36:10.925977 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:36:10.925965    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls podName:3b7b6a94-2644-427e-b115-224bd19eced1 nodeName:}" failed. No retries permitted until 2026-07-17 16:36:11.925942511 +0000 UTC m=+607.038485078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls") pod "maas-api-795f6f67d-qjglm" (UID: "3b7b6a94-2644-427e-b115-224bd19eced1") : secret "maas-api-serving-cert" not found
Jul 17 16:36:11.026605 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.026562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4d8z\" (UniqueName: \"kubernetes.io/projected/0c06e839-75fc-44a0-912a-5910be30e1c9-kube-api-access-t4d8z\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:11.026605 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.026611    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:11.026856 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.026661    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b64mp\" (UniqueName: \"kubernetes.io/projected/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-kube-api-access-b64mp\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:11.026856 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.026685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c06e839-75fc-44a0-912a-5910be30e1c9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:11.027519 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.027494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:11.027623 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.027547    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0c06e839-75fc-44a0-912a-5910be30e1c9-plugins-config-volume\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:11.036499 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.036436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4d8z\" (UniqueName: \"kubernetes.io/projected/0c06e839-75fc-44a0-912a-5910be30e1c9-kube-api-access-t4d8z\") pod \"payload-processing-5bf47cd988-2rrvv\" (UID: \"0c06e839-75fc-44a0-912a-5910be30e1c9\") " pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:11.036650 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.036632    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b64mp\" (UniqueName: \"kubernetes.io/projected/6ad944ed-7ef4-4a27-8ba8-c1464edc13c8-kube-api-access-b64mp\") pod \"payload-pre-processing-7677b774bb-bfk76\" (UID: \"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:11.096741 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.096699    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:11.171850 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.171815    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:11.257708 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.257670    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-2rrvv"]
Jul 17 16:36:11.258859 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:36:11.258823    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c06e839_75fc_44a0_912a_5910be30e1c9.slice/crio-a73157614d7776bef65d11d1eab8068a9300231b5663c5ff48ad335097560b9e WatchSource:0}: Error finding container a73157614d7776bef65d11d1eab8068a9300231b5663c5ff48ad335097560b9e: Status 404 returned error can't find the container with id a73157614d7776bef65d11d1eab8068a9300231b5663c5ff48ad335097560b9e
Jul 17 16:36:11.260875 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.260853    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:36:11.323726 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.323687    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-bfk76"]
Jul 17 16:36:11.325780 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:36:11.325753    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ad944ed_7ef4_4a27_8ba8_c1464edc13c8.slice/crio-76597d67bd057dd9787e249ae9f6f47a3d97a6a3bcc762809d2f4436aa24cc84 WatchSource:0}: Error finding container 76597d67bd057dd9787e249ae9f6f47a3d97a6a3bcc762809d2f4436aa24cc84: Status 404 returned error can't find the container with id 76597d67bd057dd9787e249ae9f6f47a3d97a6a3bcc762809d2f4436aa24cc84
Jul 17 16:36:11.934221 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.933575    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:11.938772 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:11.938706    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b7b6a94-2644-427e-b115-224bd19eced1-maas-api-tls\") pod \"maas-api-795f6f67d-qjglm\" (UID: \"3b7b6a94-2644-427e-b115-224bd19eced1\") " pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:12.008015 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:12.007701    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:12.183027 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:12.182858    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv" event={"ID":"0c06e839-75fc-44a0-912a-5910be30e1c9","Type":"ContainerStarted","Data":"a73157614d7776bef65d11d1eab8068a9300231b5663c5ff48ad335097560b9e"}
Jul 17 16:36:12.184730 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:12.184658    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76" event={"ID":"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8","Type":"ContainerStarted","Data":"76597d67bd057dd9787e249ae9f6f47a3d97a6a3bcc762809d2f4436aa24cc84"}
Jul 17 16:36:12.213881 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:12.213843    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"]
Jul 17 16:36:12.217608 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:36:12.215988    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7b6a94_2644_427e_b115_224bd19eced1.slice/crio-2cf2969a00bf87f302bc1ba01ebdc3e0fa23710b892795f923c5d3bc67fc7a0d WatchSource:0}: Error finding container 2cf2969a00bf87f302bc1ba01ebdc3e0fa23710b892795f923c5d3bc67fc7a0d: Status 404 returned error can't find the container with id 2cf2969a00bf87f302bc1ba01ebdc3e0fa23710b892795f923c5d3bc67fc7a0d
Jul 17 16:36:13.191578 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.191543    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76" event={"ID":"6ad944ed-7ef4-4a27-8ba8-c1464edc13c8","Type":"ContainerStarted","Data":"3e5ae4671efba9b28a1fa57fc38a6cb08acbd9370f91c6b5e6e493cdac648b98"}
Jul 17 16:36:13.192054 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.191609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:13.192887 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.192861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm" event={"ID":"3b7b6a94-2644-427e-b115-224bd19eced1","Type":"ContainerStarted","Data":"2cf2969a00bf87f302bc1ba01ebdc3e0fa23710b892795f923c5d3bc67fc7a0d"}
Jul 17 16:36:13.194291 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.194271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv" event={"ID":"0c06e839-75fc-44a0-912a-5910be30e1c9","Type":"ContainerStarted","Data":"c091cbef9679f31a314a4c3e5a89f5205b059761cbe0a04c3c34d786af14c36f"}
Jul 17 16:36:13.194384 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.194310    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:13.221884 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.221803    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76" podStartSLOduration=1.507462301 podStartE2EDuration="3.221780262s" totalImagesPullingTime="1.714317961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:13.220326741 +0000 UTC m=+608.332869320" watchObservedRunningTime="2026-07-17 16:36:13.221780262 +0000 UTC m=+608.334322839"
Jul 17 16:36:13.239868 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:13.239798    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv" podStartSLOduration=1.465354572 podStartE2EDuration="3.239775598s" totalImagesPullingTime="1.774421026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:13.236593033 +0000 UTC m=+608.349135612" watchObservedRunningTime="2026-07-17 16:36:13.239775598 +0000 UTC m=+608.352318174"
Jul 17 16:36:15.206642 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:15.206603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm" event={"ID":"3b7b6a94-2644-427e-b115-224bd19eced1","Type":"ContainerStarted","Data":"a4be40709ab0a05816368ab974db7429f8ff53dbdd5ab8d1f1ee65b31d30a93c"}
Jul 17 16:36:15.207004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:15.206723    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:15.227526 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:15.227476    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm" podStartSLOduration=3.021498185 podStartE2EDuration="5.227459197s" totalImagesPullingTime="2.205961012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:15.226060567 +0000 UTC m=+610.338603143" watchObservedRunningTime="2026-07-17 16:36:15.227459197 +0000 UTC m=+610.340001800"
Jul 17 16:36:21.217211 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:21.217176    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-795f6f67d-qjglm"
Jul 17 16:36:24.201729 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:24.201693    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-2rrvv"
Jul 17 16:36:24.202158 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:24.202031    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-bfk76"
Jul 17 16:36:33.594853 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.594771    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"]
Jul 17 16:36:33.598272 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.598249    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.600814 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.600792    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jpw69\""
Jul 17 16:36:33.601653 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.601633    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 16:36:33.601738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.601633    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 16:36:33.601738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.601702    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 16:36:33.608184 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.608158    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"]
Jul 17 16:36:33.624762 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624729    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.624913 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.624913 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624861    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.624913 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.624913 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.625045 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.624934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg7mh\" (UniqueName: \"kubernetes.io/projected/8ed473ea-e1c7-4dd6-9683-140fecdf791e-kube-api-access-zg7mh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.725836 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.725782    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.725836 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.725841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726093 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.725921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726093 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.725951    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726093 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.725974    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726093 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.726010    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg7mh\" (UniqueName: \"kubernetes.io/projected/8ed473ea-e1c7-4dd6-9683-140fecdf791e-kube-api-access-zg7mh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726366 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.726303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726366 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.726345    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.726450 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.726395    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.728514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.728491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8ed473ea-e1c7-4dd6-9683-140fecdf791e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.728685 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.728669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ed473ea-e1c7-4dd6-9683-140fecdf791e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.733716 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.733689    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg7mh\" (UniqueName: \"kubernetes.io/projected/8ed473ea-e1c7-4dd6-9683-140fecdf791e-kube-api-access-zg7mh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj\" (UID: \"8ed473ea-e1c7-4dd6-9683-140fecdf791e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:33.910028 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:33.909990    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:34.050527 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:34.050502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"]
Jul 17 16:36:34.052377 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:36:34.052343    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed473ea_e1c7_4dd6_9683_140fecdf791e.slice/crio-486b9f5db41b9bd5c5c0f8d98fa9f5d2458aa10017b8a6ca7330f496491b9931 WatchSource:0}: Error finding container 486b9f5db41b9bd5c5c0f8d98fa9f5d2458aa10017b8a6ca7330f496491b9931: Status 404 returned error can't find the container with id 486b9f5db41b9bd5c5c0f8d98fa9f5d2458aa10017b8a6ca7330f496491b9931
Jul 17 16:36:34.313672 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:34.313589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj" event={"ID":"8ed473ea-e1c7-4dd6-9683-140fecdf791e","Type":"ContainerStarted","Data":"486b9f5db41b9bd5c5c0f8d98fa9f5d2458aa10017b8a6ca7330f496491b9931"}
Jul 17 16:36:35.320464 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:35.320428    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj" event={"ID":"8ed473ea-e1c7-4dd6-9683-140fecdf791e","Type":"ContainerStarted","Data":"fa403a0f338cd00dd2626cb96579d341c22a6cbde583b0a68fa01a71a066df44"}
Jul 17 16:36:35.338787 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:35.338733    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj" podStartSLOduration=1.22932739 podStartE2EDuration="2.338715325s" totalImagesPullingTime="1.109387935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:36:35.337494084 +0000 UTC m=+630.450036679" watchObservedRunningTime="2026-07-17 16:36:35.338715325 +0000 UTC m=+630.451257900"
Jul 17 16:36:43.910467 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:43.910425    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:43.910951 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:43.910499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:43.922947 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:43.922921    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:36:44.377032 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:36:44.376943    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj"
Jul 17 16:37:11.197086 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.197047    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"]
Jul 17 16:37:11.203583 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.203561    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.206379 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.206358    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 16:37:11.210478 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.210452    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"]
Jul 17 16:37:11.362157 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.362349 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.362349 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362259    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6zpb\" (UniqueName: \"kubernetes.io/projected/b2185a37-038a-4938-af81-cb77f16a416f-kube-api-access-x6zpb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.362349 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.362509 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.362509 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.362430    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2185a37-038a-4938-af81-cb77f16a416f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.463853 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.463760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.463853 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.463801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2185a37-038a-4938-af81-cb77f16a416f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464048 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.463937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464048 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464006    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464048 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464037    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6zpb\" (UniqueName: \"kubernetes.io/projected/b2185a37-038a-4938-af81-cb77f16a416f-kube-api-access-x6zpb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464235 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464332 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464311    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464406 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464385    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.464532 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.464475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.466212 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.466180    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2185a37-038a-4938-af81-cb77f16a416f-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.466482 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.466467    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2185a37-038a-4938-af81-cb77f16a416f-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.472364 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.472344    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6zpb\" (UniqueName: \"kubernetes.io/projected/b2185a37-038a-4938-af81-cb77f16a416f-kube-api-access-x6zpb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g\" (UID: \"b2185a37-038a-4938-af81-cb77f16a416f\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.515955 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.515919    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:11.655172 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:11.655147    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"]
Jul 17 16:37:11.657550 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:37:11.657517    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2185a37_038a_4938_af81_cb77f16a416f.slice/crio-0462aafdb44fcd27d7fc4a59d0f06c2322c7cde0ea987827877df9082a3118d7 WatchSource:0}: Error finding container 0462aafdb44fcd27d7fc4a59d0f06c2322c7cde0ea987827877df9082a3118d7: Status 404 returned error can't find the container with id 0462aafdb44fcd27d7fc4a59d0f06c2322c7cde0ea987827877df9082a3118d7
Jul 17 16:37:12.505885 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:12.505845    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g" event={"ID":"b2185a37-038a-4938-af81-cb77f16a416f","Type":"ContainerStarted","Data":"1e1e988f1463640c17fea996604ed5aad595f071fff546e03d25f54b5101f273"}
Jul 17 16:37:12.506328 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:12.505898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g" event={"ID":"b2185a37-038a-4938-af81-cb77f16a416f","Type":"ContainerStarted","Data":"0462aafdb44fcd27d7fc4a59d0f06c2322c7cde0ea987827877df9082a3118d7"}
Jul 17 16:37:12.528090 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:12.528033    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g" podStartSLOduration=1.335948406 podStartE2EDuration="1.528014112s" totalImagesPullingTime="192.065706ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:37:12.525864177 +0000 UTC m=+667.638406774" watchObservedRunningTime="2026-07-17 16:37:12.528014112 +0000 UTC m=+667.640556689"
Jul 17 16:37:21.516347 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:21.516305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:21.516747 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:21.516368    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:21.529198 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:21.529168    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:37:21.566558 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:37:21.566530    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g"
Jul 17 16:39:35.258546 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.258462    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:39:35.259142 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.258671    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-66fdc48964-lbp4d" podUID="e6d570c1-db49-487d-b6d0-0246fe23aa92" containerName="manager" containerID="cri-o://3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8" gracePeriod=30
Jul 17 16:39:35.512396 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.512322    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:39:35.590950 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.590918    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert\") pod \"e6d570c1-db49-487d-b6d0-0246fe23aa92\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") "
Jul 17 16:39:35.591120 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.590984    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbngn\" (UniqueName: \"kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn\") pod \"e6d570c1-db49-487d-b6d0-0246fe23aa92\" (UID: \"e6d570c1-db49-487d-b6d0-0246fe23aa92\") "
Jul 17 16:39:35.593142 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.593094    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e6d570c1-db49-487d-b6d0-0246fe23aa92" (UID: "e6d570c1-db49-487d-b6d0-0246fe23aa92"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:39:35.593142 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.593111    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn" (OuterVolumeSpecName: "kube-api-access-xbngn") pod "e6d570c1-db49-487d-b6d0-0246fe23aa92" (UID: "e6d570c1-db49-487d-b6d0-0246fe23aa92"). InnerVolumeSpecName "kube-api-access-xbngn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:39:35.691730 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.691680    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbngn\" (UniqueName: \"kubernetes.io/projected/e6d570c1-db49-487d-b6d0-0246fe23aa92-kube-api-access-xbngn\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:39:35.691730 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:35.691728    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e6d570c1-db49-487d-b6d0-0246fe23aa92-webhook-cert\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:39:36.252558 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.252520    2558 generic.go:356] "Generic (PLEG): container finished" podID="e6d570c1-db49-487d-b6d0-0246fe23aa92" containerID="3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8" exitCode=0
Jul 17 16:39:36.252776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.252578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-lbp4d"
Jul 17 16:39:36.252776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.252610    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-lbp4d" event={"ID":"e6d570c1-db49-487d-b6d0-0246fe23aa92","Type":"ContainerDied","Data":"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"}
Jul 17 16:39:36.252776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.252694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-lbp4d" event={"ID":"e6d570c1-db49-487d-b6d0-0246fe23aa92","Type":"ContainerDied","Data":"6f312bb49efe5cdc8f77e2089083158b99906f328d37df5630062b41c304ed9e"}
Jul 17 16:39:36.252776 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.252727    2558 scope.go:117] "RemoveContainer" containerID="3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"
Jul 17 16:39:36.261986 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.261841    2558 scope.go:117] "RemoveContainer" containerID="3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"
Jul 17 16:39:36.262310 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:39:36.262285    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8\": container with ID starting with 3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8 not found: ID does not exist" containerID="3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"
Jul 17 16:39:36.262372 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.262324    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8"} err="failed to get container status \"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8\": rpc error: code = NotFound desc = could not find container \"3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8\": container with ID starting with 3d1524a0b7ce95e60c6deb205af8bc86cdd4746f22c0713f0e2defef109914c8 not found: ID does not exist"
Jul 17 16:39:36.276411 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.276375    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:39:36.278541 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:36.278519    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66fdc48964-lbp4d"]
Jul 17 16:39:37.414935 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:39:37.414898    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6d570c1-db49-487d-b6d0-0246fe23aa92" path="/var/lib/kubelet/pods/e6d570c1-db49-487d-b6d0-0246fe23aa92/volumes"
Jul 17 16:40:37.080232 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.080194    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:37.080724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.080553    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6d570c1-db49-487d-b6d0-0246fe23aa92" containerName="manager"
Jul 17 16:40:37.080724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.080563    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6d570c1-db49-487d-b6d0-0246fe23aa92" containerName="manager"
Jul 17 16:40:37.080724 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.080617    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6d570c1-db49-487d-b6d0-0246fe23aa92" containerName="manager"
Jul 17 16:40:37.083693 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.083675    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.087186 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.087111    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 16:40:37.087186 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.087185    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 16:40:37.087408 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.087111    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rwhw5\""
Jul 17 16:40:37.093659 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.093630    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:37.126824 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.126781    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x767m\" (UniqueName: \"kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.127009 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.126839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.228315 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.228272    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x767m\" (UniqueName: \"kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.228486 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.228331    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.230899 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.230876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.236552 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.236526    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x767m\" (UniqueName: \"kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m\") pod \"maas-controller-66fdc48964-jvhw2\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") " pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.394928 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.394831    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:37.536093 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.536060    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:37.537629 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:40:37.537602    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2c7082_cacf_40df_afa0_29236dcf7d8a.slice/crio-7f2892a8399987f70d8c96b58b8f2bdfa10a60eef16155f19b17d876fdcba7b4 WatchSource:0}: Error finding container 7f2892a8399987f70d8c96b58b8f2bdfa10a60eef16155f19b17d876fdcba7b4: Status 404 returned error can't find the container with id 7f2892a8399987f70d8c96b58b8f2bdfa10a60eef16155f19b17d876fdcba7b4
Jul 17 16:40:37.561938 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:37.561906    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-jvhw2" event={"ID":"4f2c7082-cacf-40df-afa0-29236dcf7d8a","Type":"ContainerStarted","Data":"7f2892a8399987f70d8c96b58b8f2bdfa10a60eef16155f19b17d876fdcba7b4"}
Jul 17 16:40:38.568410 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:38.568371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-jvhw2" event={"ID":"4f2c7082-cacf-40df-afa0-29236dcf7d8a","Type":"ContainerStarted","Data":"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"}
Jul 17 16:40:38.568834 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:38.568512    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:38.586583 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:38.586526    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66fdc48964-jvhw2" podStartSLOduration=1.048573258 podStartE2EDuration="1.586509604s" totalImagesPullingTime="537.936346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:40:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:40:38.584361734 +0000 UTC m=+873.696904328" watchObservedRunningTime="2026-07-17 16:40:38.586509604 +0000 UTC m=+873.699052210"
Jul 17 16:40:49.576178 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:49.576118    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:54.204885 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.204849    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:54.205560 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.205070    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-66fdc48964-jvhw2" podUID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" containerName="manager" containerID="cri-o://624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d" gracePeriod=30
Jul 17 16:40:54.455263 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.455196    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:54.587340 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.587298    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x767m\" (UniqueName: \"kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m\") pod \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") "
Jul 17 16:40:54.587514 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.587352    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert\") pod \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\" (UID: \"4f2c7082-cacf-40df-afa0-29236dcf7d8a\") "
Jul 17 16:40:54.589640 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.589595    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4f2c7082-cacf-40df-afa0-29236dcf7d8a" (UID: "4f2c7082-cacf-40df-afa0-29236dcf7d8a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 16:40:54.589782 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.589728    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m" (OuterVolumeSpecName: "kube-api-access-x767m") pod "4f2c7082-cacf-40df-afa0-29236dcf7d8a" (UID: "4f2c7082-cacf-40df-afa0-29236dcf7d8a"). InnerVolumeSpecName "kube-api-access-x767m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 16:40:54.652217 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.652181    2558 generic.go:356] "Generic (PLEG): container finished" podID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" containerID="624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d" exitCode=0
Jul 17 16:40:54.652217 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.652221    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-jvhw2"
Jul 17 16:40:54.652451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.652273    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-jvhw2" event={"ID":"4f2c7082-cacf-40df-afa0-29236dcf7d8a","Type":"ContainerDied","Data":"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"}
Jul 17 16:40:54.652451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.652332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-jvhw2" event={"ID":"4f2c7082-cacf-40df-afa0-29236dcf7d8a","Type":"ContainerDied","Data":"7f2892a8399987f70d8c96b58b8f2bdfa10a60eef16155f19b17d876fdcba7b4"}
Jul 17 16:40:54.652451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.652358    2558 scope.go:117] "RemoveContainer" containerID="624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"
Jul 17 16:40:54.662694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.662675    2558 scope.go:117] "RemoveContainer" containerID="624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"
Jul 17 16:40:54.663001 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:40:54.662979    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d\": container with ID starting with 624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d not found: ID does not exist" containerID="624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"
Jul 17 16:40:54.663046 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.663015    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d"} err="failed to get container status \"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d\": rpc error: code = NotFound desc = could not find container \"624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d\": container with ID starting with 624b7eb14472592b786ebd48080a8fca679501330b4e493f50bd618171d70a6d not found: ID does not exist"
Jul 17 16:40:54.674095 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.674066    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:54.680161 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.680118    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-66fdc48964-jvhw2"]
Jul 17 16:40:54.688738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.688714    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x767m\" (UniqueName: \"kubernetes.io/projected/4f2c7082-cacf-40df-afa0-29236dcf7d8a-kube-api-access-x767m\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:40:54.688738 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:54.688741    2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4f2c7082-cacf-40df-afa0-29236dcf7d8a-webhook-cert\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 16:40:55.414642 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.414562    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" path="/var/lib/kubelet/pods/4f2c7082-cacf-40df-afa0-29236dcf7d8a/volumes"
Jul 17 16:40:55.439870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.438164    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-66fdc48964-299g2"]
Jul 17 16:40:55.439870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.439069    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" containerName="manager"
Jul 17 16:40:55.439870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.439090    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" containerName="manager"
Jul 17 16:40:55.439870 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.439321    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f2c7082-cacf-40df-afa0-29236dcf7d8a" containerName="manager"
Jul 17 16:40:55.445286 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.445258    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.449147 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.449064    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 16:40:55.449350 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.449074    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 16:40:55.449444 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.449348    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rwhw5\""
Jul 17 16:40:55.450696 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.450672    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-299g2"]
Jul 17 16:40:55.596769 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.596733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sf8g\" (UniqueName: \"kubernetes.io/projected/2630a6e6-4908-407f-bc34-8eebed0a637f-kube-api-access-8sf8g\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.596939 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.596792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2630a6e6-4908-407f-bc34-8eebed0a637f-webhook-cert\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.697754 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.697663    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sf8g\" (UniqueName: \"kubernetes.io/projected/2630a6e6-4908-407f-bc34-8eebed0a637f-kube-api-access-8sf8g\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.697754 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.697728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2630a6e6-4908-407f-bc34-8eebed0a637f-webhook-cert\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.700423 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.700397    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2630a6e6-4908-407f-bc34-8eebed0a637f-webhook-cert\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.707371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.707347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sf8g\" (UniqueName: \"kubernetes.io/projected/2630a6e6-4908-407f-bc34-8eebed0a637f-kube-api-access-8sf8g\") pod \"maas-controller-66fdc48964-299g2\" (UID: \"2630a6e6-4908-407f-bc34-8eebed0a637f\") " pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.757502 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.757464    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:55.900960 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:55.900928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-66fdc48964-299g2"]
Jul 17 16:40:55.902922 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:40:55.902887    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2630a6e6_4908_407f_bc34_8eebed0a637f.slice/crio-7443b93c61ac7fcb35880854769c2eedccb47600278c4b361a0e1b8a02f7c6ed WatchSource:0}: Error finding container 7443b93c61ac7fcb35880854769c2eedccb47600278c4b361a0e1b8a02f7c6ed: Status 404 returned error can't find the container with id 7443b93c61ac7fcb35880854769c2eedccb47600278c4b361a0e1b8a02f7c6ed
Jul 17 16:40:56.665340 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:56.665303    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-299g2" event={"ID":"2630a6e6-4908-407f-bc34-8eebed0a637f","Type":"ContainerStarted","Data":"36bb5c28056867215144ad31d52126fa4027ba4848e2e28cec0f530f12cc954e"}
Jul 17 16:40:56.665758 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:56.665361    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-66fdc48964-299g2" event={"ID":"2630a6e6-4908-407f-bc34-8eebed0a637f","Type":"ContainerStarted","Data":"7443b93c61ac7fcb35880854769c2eedccb47600278c4b361a0e1b8a02f7c6ed"}
Jul 17 16:40:56.665758 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:56.665395    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:40:56.684316 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:40:56.684265    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-66fdc48964-299g2" podStartSLOduration=1.294254619 podStartE2EDuration="1.684246777s" totalImagesPullingTime="389.992158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:40:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:40:56.681834705 +0000 UTC m=+891.794377284" watchObservedRunningTime="2026-07-17 16:40:56.684246777 +0000 UTC m=+891.796789352"
Jul 17 16:41:05.359600 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:41:05.359565    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:41:05.360081 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:41:05.359671    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:41:07.673453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:41:07.673420    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-66fdc48964-299g2"
Jul 17 16:45:00.153194 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.153154    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"]
Jul 17 16:45:00.156743 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.156724    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"
Jul 17 16:45:00.160399 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.160379    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6zx8f\""
Jul 17 16:45:00.166386 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.166366    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"
Jul 17 16:45:00.184517 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.184459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"]
Jul 17 16:45:00.513029 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.512994    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"]
Jul 17 16:45:00.515020 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:45:00.514993    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb732cc12_746f_4cbf_9c80_68baf65ec343.slice/crio-1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34 WatchSource:0}: Error finding container 1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34: Status 404 returned error can't find the container with id 1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34
Jul 17 16:45:00.517009 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.516990    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:45:00.913973 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:00.913942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np" event={"ID":"b732cc12-746f-4cbf-9c80-68baf65ec343","Type":"ContainerStarted","Data":"1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34"}
Jul 17 16:45:03.931746 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:03.931709    2558 generic.go:356] "Generic (PLEG): container finished" podID="b732cc12-746f-4cbf-9c80-68baf65ec343" containerID="b9405e93dffeadd61470d29b7a869e500aeb0174abb2f7c403eca5db7f3e6d87" exitCode=0
Jul 17 16:45:03.932179 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:03.931780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np" event={"ID":"b732cc12-746f-4cbf-9c80-68baf65ec343","Type":"ContainerDied","Data":"b9405e93dffeadd61470d29b7a869e500aeb0174abb2f7c403eca5db7f3e6d87"}
Jul 17 16:45:05.072074 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:05.072047    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"
Jul 17 16:45:05.942618 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:05.942586    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"
Jul 17 16:45:05.942618 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:05.942601    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np" event={"ID":"b732cc12-746f-4cbf-9c80-68baf65ec343","Type":"ContainerDied","Data":"1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34"}
Jul 17 16:45:05.942903 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:45:05.942657    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f350778c8d01f16c6559511f367c5d5ee77a6fe611f7598b52d97c20ca90d34"
Jul 17 16:46:05.393078 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:46:05.393046    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:46:05.394986 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:46:05.394954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:51:05.427267 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:51:05.427235    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:51:05.430596 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:51:05.430571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:52:57.394895 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.394859    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"]
Jul 17 16:52:57.395368 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.395323    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b732cc12-746f-4cbf-9c80-68baf65ec343" containerName="cleanup"
Jul 17 16:52:57.395368 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.395341    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b732cc12-746f-4cbf-9c80-68baf65ec343" containerName="cleanup"
Jul 17 16:52:57.395460 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.395424    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b732cc12-746f-4cbf-9c80-68baf65ec343" containerName="cleanup"
Jul 17 16:52:57.398371 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.398334    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.400731 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.400705    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8c607776-serving-cert\""
Jul 17 16:52:57.401006 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.400989    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-cmvsl\""
Jul 17 16:52:57.421073 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.421045    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"]
Jul 17 16:52:57.509268 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.509233    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.509453 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.509371    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wff57\" (UniqueName: \"kubernetes.io/projected/627a4826-e534-48b6-8987-656a07f3c51e-kube-api-access-wff57\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.509497 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.509456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a4826-e534-48b6-8987-656a07f3c51e-openshift-service-ca\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.610771 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.610730    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wff57\" (UniqueName: \"kubernetes.io/projected/627a4826-e534-48b6-8987-656a07f3c51e-kube-api-access-wff57\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.610979 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.610794    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a4826-e534-48b6-8987-656a07f3c51e-openshift-service-ca\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.610979 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.610819    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.610979 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:52:57.610936    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-serving-cert: secret "maas-api-e2e-ait-8c607776-serving-cert" not found
Jul 17 16:52:57.611265 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:52:57.610999    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls podName:627a4826-e534-48b6-8987-656a07f3c51e nodeName:}" failed. No retries permitted until 2026-07-17 16:52:58.110983163 +0000 UTC m=+1613.223525718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls") pod "maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" (UID: "627a4826-e534-48b6-8987-656a07f3c51e") : secret "maas-api-e2e-ait-8c607776-serving-cert" not found
Jul 17 16:52:57.611633 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.611607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/627a4826-e534-48b6-8987-656a07f3c51e-openshift-service-ca\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:57.621621 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:57.621591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wff57\" (UniqueName: \"kubernetes.io/projected/627a4826-e534-48b6-8987-656a07f3c51e-kube-api-access-wff57\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:58.115830 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:58.115798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:58.118702 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:58.118672    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/627a4826-e534-48b6-8987-656a07f3c51e-maas-api-tls\") pod \"maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz\" (UID: \"627a4826-e534-48b6-8987-656a07f3c51e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:58.312277 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:58.312229    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:52:58.459624 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:58.459587    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"]
Jul 17 16:52:58.461087 ip-10-0-134-12 kubenswrapper[2558]: W0717 16:52:58.461057    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627a4826_e534_48b6_8987_656a07f3c51e.slice/crio-981e17fecce6822c26d02f6f783af3af5a2d3a4ea2b4020fe744b81c931d8759 WatchSource:0}: Error finding container 981e17fecce6822c26d02f6f783af3af5a2d3a4ea2b4020fe744b81c931d8759: Status 404 returned error can't find the container with id 981e17fecce6822c26d02f6f783af3af5a2d3a4ea2b4020fe744b81c931d8759
Jul 17 16:52:58.462462 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:58.462441    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:52:59.361813 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:59.361773    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="f645c2f2e4d81b56fa521dd7fcd9dd059b7fa1f9dfee1ad3c6aec0d58148e8f6" exitCode=1
Jul 17 16:52:59.361999 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:59.361869    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"f645c2f2e4d81b56fa521dd7fcd9dd059b7fa1f9dfee1ad3c6aec0d58148e8f6"}
Jul 17 16:52:59.361999 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:59.361920    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerStarted","Data":"981e17fecce6822c26d02f6f783af3af5a2d3a4ea2b4020fe744b81c931d8759"}
Jul 17 16:52:59.362171 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:52:59.362155    2558 scope.go:117] "RemoveContainer" containerID="f645c2f2e4d81b56fa521dd7fcd9dd059b7fa1f9dfee1ad3c6aec0d58148e8f6"
Jul 17 16:53:00.368384 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:00.368304    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6" exitCode=1
Jul 17 16:53:00.368384 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:00.368377    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"}
Jul 17 16:53:00.368815 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:00.368423    2558 scope.go:117] "RemoveContainer" containerID="f645c2f2e4d81b56fa521dd7fcd9dd059b7fa1f9dfee1ad3c6aec0d58148e8f6"
Jul 17 16:53:00.368815 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:00.368651    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:00.368893 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:00.368865    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:01.375385 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:01.375360    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:01.375781 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:01.375526    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:03.312393 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:03.312348    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:03.312832 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:03.312817    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:03.313017 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:03.312997    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:08.312855 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:08.312810    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:08.313369 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:08.313349    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:08.313624 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:08.313587    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:23.408734 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:23.408691    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:24.496756 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:24.496724    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3" exitCode=1
Jul 17 16:53:24.497205 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:24.496793    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"}
Jul 17 16:53:24.497205 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:24.496859    2558 scope.go:117] "RemoveContainer" containerID="c06e8884821fc37751cb81ce9b57de2b7fae7bd079c72b01884f96643db635f6"
Jul 17 16:53:24.497339 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:24.497217    2558 scope.go:117] "RemoveContainer" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"
Jul 17 16:53:24.497434 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:24.497412    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:28.313215 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:28.313163    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:28.313694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:28.313241    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:28.313694 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:28.313594    2558 scope.go:117] "RemoveContainer" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"
Jul 17 16:53:28.313785 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:28.313764    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:43.408773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:43.408745    2558 scope.go:117] "RemoveContainer" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"
Jul 17 16:53:43.409391 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:43.408892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:56.409004 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:56.408970    2558 scope.go:117] "RemoveContainer" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"
Jul 17 16:53:57.670755 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:57.670714    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430" exitCode=1
Jul 17 16:53:57.671185 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:57.670779    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"}
Jul 17 16:53:57.671185 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:57.670838    2558 scope.go:117] "RemoveContainer" containerID="b44e2d027846e551960834aa52749b3909765e1a5fb3b1ac03d0302a1e178eb3"
Jul 17 16:53:57.671309 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:57.671228    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:53:57.671452 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:57.671429    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:53:58.312996 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:58.312962    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:58.313205 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:58.313027    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:53:58.678281 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:53:58.678255    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:53:58.678685 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:53:58.678446    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:54:11.409014 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:11.408970    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:54:11.409592 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:54:11.409246    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:54:25.412343 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:25.411628    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:54:25.412343 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:54:25.411836    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:54:38.408510 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:38.408478    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:54:39.891878 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:39.891843    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b" exitCode=1
Jul 17 16:54:39.892304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:39.891926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"}
Jul 17 16:54:39.892304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:39.891989    2558 scope.go:117] "RemoveContainer" containerID="b63e0a771387428b3e742d3bb1fdae58f14d52a05289ca2bc3be7f5f76008430"
Jul 17 16:54:39.892304 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:39.892287    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:54:39.892499 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:54:39.892479    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:54:43.313077 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:43.313035    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:54:43.313561 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:43.313483    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:54:43.313670 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:54:43.313647    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:54:48.313184 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:48.313148    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:54:48.313579 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:54:48.313546    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:54:48.313726 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:54:48.313706    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:55:00.409424 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:55:00.409384    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:55:00.409813 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:55:00.409606    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:55:11.409424 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:55:11.409391    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:55:11.409920 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:55:11.409577    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:55:25.411773 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:55:25.411743    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:55:25.412308 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:55:25.412001    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:55:37.409010 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:55:37.408976    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:55:37.409448 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:55:37.409176    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:55:49.408833 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:55:49.408786    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:55:49.409459 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:55:49.408983    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:03.409052 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:03.409012    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:56:04.334509 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:04.334474    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470" exitCode=1
Jul 17 16:56:04.334702 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:04.334556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"}
Jul 17 16:56:04.334702 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:04.334651    2558 scope.go:117] "RemoveContainer" containerID="c5ae6bda050e5b0b46d013998f4296366fa85364f1ef12a6af29547ddc5eed8b"
Jul 17 16:56:04.334981 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:04.334955    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:04.335240 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:04.335220    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:05.460409 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:05.460373    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:56:05.464361 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:05.464335    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 16:56:08.313120 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:08.313080    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:56:08.313544 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:08.313190    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:56:08.313544 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:08.313522    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:08.313714 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:08.313693    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:20.409395 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:20.409356    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:20.409874 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:20.409605    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:32.408643 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:32.408606    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:32.409145 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:32.408790    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:45.411114 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:45.411074    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:45.411694 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:45.411343    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:56:57.408709 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:56:57.408675    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:56:57.409156 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:56:57.408846    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:57:11.408829 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:57:11.408793    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:57:11.409238 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:57:11.408973    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:57:25.412113 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:57:25.412020    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:57:25.412578 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:57:25.412261    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:57:40.409417 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:57:40.409376    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:57:40.409848 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:57:40.409596    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:57:51.409651 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:57:51.409618    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:57:51.410043 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:57:51.409807    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:06.408917 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:06.408879    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:58:06.411320 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:06.409101    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:20.409107 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:20.409076    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:58:20.409513 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:20.409352    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:31.408843 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:31.408811    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:58:31.409318 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:31.409005    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:44.409458 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:44.409426    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:58:44.409871 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:44.409728    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 16:58:45.181019 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:45.180977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerStarted","Data":"eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"}
Jul 17 16:58:45.181329 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:45.181307    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:58:45.200642 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:45.200590    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podStartSLOduration=345.459092263 podStartE2EDuration="5m48.200575372s" totalImagesPullingTime="2.741483109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 16:52:57 +0000 UTC" imagePullSessionsCount=7 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 16:58:45.199542086 +0000 UTC m=+1960.312084662" watchObservedRunningTime="2026-07-17 16:58:45.200575372 +0000 UTC m=+1960.313117975"
Jul 17 16:58:46.188451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:46.188409    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7" exitCode=1
Jul 17 16:58:46.188451 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:46.188457    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"}
Jul 17 16:58:46.188989 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:46.188509    2558 scope.go:117] "RemoveContainer" containerID="368c662b79066f6f64e0e3c1e6727fdc1038ee0a84a24c135ccdfa700e0c2470"
Jul 17 16:58:46.188989 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:46.188778    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:58:46.189094 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:46.189024    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:47.196067 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:47.196034    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:58:47.196503 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:47.196237    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:58:48.313166 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:48.313109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 16:58:48.313673 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:58:48.313616    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:58:48.313894 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:58:48.313866    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:59:02.409543 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:59:02.409461    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:59:02.409984 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:59:02.409674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:59:14.409415 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:59:14.409385    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:59:14.409781 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:59:14.409574    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:59:25.410961 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:59:25.410926    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:59:25.411383 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:59:25.411154    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:59:40.409151 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:59:40.409087    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:59:40.409615 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:59:40.409284    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 16:59:52.408991 ip-10-0-134-12 kubenswrapper[2558]: I0717 16:59:52.408956    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 16:59:52.409439 ip-10-0-134-12 kubenswrapper[2558]: E0717 16:59:52.409163    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:00:05.411215 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:00:05.411178    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:00:05.411621 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:00:05.411378    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:00:19.408877 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:00:19.408837    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:00:19.409424 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:00:19.409047    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:00:30.408489 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:00:30.408406    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:00:30.408945 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:00:30.408625    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:00:45.418314 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:00:45.418282    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:00:45.418889 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:00:45.418470    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:01:00.408753 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:00.408722    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:01:00.409187 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:00.408914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:01:05.493764 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:05.493731    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:01:05.499421 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:05.499399    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:01:06.324114 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.324075    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"]
Jul 17 17:01:06.327903 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.327881    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.331627 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.331602    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a8e6750e-serving-cert\""
Jul 17 17:01:06.343332 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.343300    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"]
Jul 17 17:01:06.520367 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.520322    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rzzs\" (UniqueName: \"kubernetes.io/projected/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-kube-api-access-4rzzs\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.520798 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.520412    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-maas-api-tls\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.520798 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.520460    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-openshift-service-ca\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.621964 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.621851    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-maas-api-tls\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.621964 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.621898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-openshift-service-ca\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.621964 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.621942    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rzzs\" (UniqueName: \"kubernetes.io/projected/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-kube-api-access-4rzzs\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.622576 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.622553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-openshift-service-ca\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.624719 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.624682    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-maas-api-tls\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.632515 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.632491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rzzs\" (UniqueName: \"kubernetes.io/projected/249b1bb3-16f3-43c9-9cf8-b3fd666b4890-kube-api-access-4rzzs\") pod \"maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2\" (UID: \"249b1bb3-16f3-43c9-9cf8-b3fd666b4890\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.639321 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.639291    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:06.792607 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.792576    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"]
Jul 17 17:01:06.794831 ip-10-0-134-12 kubenswrapper[2558]: W0717 17:01:06.794805    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249b1bb3_16f3_43c9_9cf8_b3fd666b4890.slice/crio-b72108c4506bdc11967dff58b8d6d63a3070dc5ade7e9960c9820bc64f955d0c WatchSource:0}: Error finding container b72108c4506bdc11967dff58b8d6d63a3070dc5ade7e9960c9820bc64f955d0c: Status 404 returned error can't find the container with id b72108c4506bdc11967dff58b8d6d63a3070dc5ade7e9960c9820bc64f955d0c
Jul 17 17:01:06.914293 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:06.914254    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerStarted","Data":"b72108c4506bdc11967dff58b8d6d63a3070dc5ade7e9960c9820bc64f955d0c"}
Jul 17 17:01:07.921795 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:07.921756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerStarted","Data":"0922465a352c75e2b426a9c0aa697e11aca862b1a2cbb06a190db455acbe5bb3"}
Jul 17 17:01:07.922269 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:07.921866    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:07.949169 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:07.949092    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podStartSLOduration=1.008660514 podStartE2EDuration="1.949076533s" totalImagesPullingTime="940.416019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:01:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:01:07.948339258 +0000 UTC m=+2103.060881834" watchObservedRunningTime="2026-07-17 17:01:07.949076533 +0000 UTC m=+2103.061619109"
Jul 17 17:01:08.928267 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:08.928233    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="0922465a352c75e2b426a9c0aa697e11aca862b1a2cbb06a190db455acbe5bb3" exitCode=1
Jul 17 17:01:08.928676 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:08.928300    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"0922465a352c75e2b426a9c0aa697e11aca862b1a2cbb06a190db455acbe5bb3"}
Jul 17 17:01:08.928676 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:08.928514    2558 scope.go:117] "RemoveContainer" containerID="0922465a352c75e2b426a9c0aa697e11aca862b1a2cbb06a190db455acbe5bb3"
Jul 17 17:01:09.934976 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:09.934946    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576" exitCode=1
Jul 17 17:01:09.935456 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:09.935032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"}
Jul 17 17:01:09.935456 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:09.935099    2558 scope.go:117] "RemoveContainer" containerID="0922465a352c75e2b426a9c0aa697e11aca862b1a2cbb06a190db455acbe5bb3"
Jul 17 17:01:09.935456 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:09.935285    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:09.935624 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:09.935506    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:10.941840 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:10.941810    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:10.942280 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:10.941982    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:12.922835 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:12.922794    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:12.923342 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:12.923283    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:12.923495 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:12.923468    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:13.409013 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:13.408986    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:01:13.409233 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:13.409209    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:01:16.639892 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:16.639853    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:16.640534 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:16.640358    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:16.640631 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:16.640603    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:28.409382 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:28.409341    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:28.409869 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:28.409438    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:01:28.409869 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:28.409635    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:01:29.041940 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:29.041854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerStarted","Data":"8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"}
Jul 17 17:01:29.042088 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:29.042061    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:30.048804 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:30.048764    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d" exitCode=1
Jul 17 17:01:30.049260 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:30.048849    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"}
Jul 17 17:01:30.049260 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:30.048915    2558 scope.go:117] "RemoveContainer" containerID="51155792731c0c61afe19403adf9f7cb9624cb8affb75d4ed5d3339c0b701576"
Jul 17 17:01:30.049260 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:30.049065    2558 scope.go:117] "RemoveContainer" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"
Jul 17 17:01:30.049426 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:30.049307    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:31.055916 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:31.055886    2558 scope.go:117] "RemoveContainer" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"
Jul 17 17:01:31.056358 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:31.056075    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:36.640268 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:36.640229    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:36.640661 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:36.640625    2558 scope.go:117] "RemoveContainer" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"
Jul 17 17:01:36.640809 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:36.640788    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:43.408930 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:43.408899    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:01:43.409380 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:43.409079    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:01:49.408951 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:49.408904    2558 scope.go:117] "RemoveContainer" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"
Jul 17 17:01:50.154369 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:50.154338    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545" exitCode=1
Jul 17 17:01:50.154561 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:50.154395    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"}
Jul 17 17:01:50.154561 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:50.154443    2558 scope.go:117] "RemoveContainer" containerID="8eaa34fa9a7477ab886b1aab82d9357ae2a96bd1cf5a9cc7ddf0096f2132b92d"
Jul 17 17:01:50.154794 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:50.154764    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:01:50.155032 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:50.155008    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:54.042641 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:54.042606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:54.043027 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:54.043004    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:01:54.043227 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:54.043200    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:56.639637 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:56.639541    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:01:56.640002 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:56.639967    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:01:56.640197 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:56.640176    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:01:58.408915 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:01:58.408877    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:01:58.409344 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:01:58.409057    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:02:08.409217 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:08.409181    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:02:08.409645 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:08.409378    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:02:10.408959 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:10.408922    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:02:10.409433 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:10.409098    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:02:22.409111 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:22.409066    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:02:22.409662 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:22.409395    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:02:23.409238 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:23.409206    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:02:23.409635 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:23.409400    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:02:37.408656 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:37.408621    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:02:37.408656 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:37.408658    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:02:37.409300 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:37.408804    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:02:38.403682 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:38.403588    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864" exitCode=1
Jul 17 17:02:38.403682 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:38.403663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"}
Jul 17 17:02:38.403914 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:38.403742    2558 scope.go:117] "RemoveContainer" containerID="1e69300f5526cc19d7fed5fb79181add74fef2d87402bec5e20ed0201201e545"
Jul 17 17:02:38.404155 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:38.404141    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:02:38.404384 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:38.404359    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:02:39.042892 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:39.042853    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:02:39.411168 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:39.411115    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:02:39.411380 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:39.411353    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:02:46.639944 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:46.639904    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:02:46.640372 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:46.640345    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:02:46.640524 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:46.640503    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:02:48.409303 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:48.409268    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:02:48.409696 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:48.409479    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:02:57.409021 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:02:57.408977    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:02:57.409565 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:02:57.409277    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:03:00.408705 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:00.408668    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:00.409158 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:00.408862    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:10.409409 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:10.409372    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:03:10.411826 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:10.409577    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:03:11.408703 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:11.408658    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:11.408921 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:11.408891    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:23.414230 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:23.414196    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:03:23.414622 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:23.414376    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:03:26.409077 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:26.408993    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:26.409450 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:26.409217    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:37.408829 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:37.408785    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:03:37.409331 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:37.408903    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:37.409331 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:37.409028    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:03:37.409331 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:37.409028    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:49.409575 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:49.409539    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:03:49.409983 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:49.409733    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:03:50.409084 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:50.409055    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:50.409428 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:50.409413    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:03:51.783881 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:51.783839    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275" exitCode=1
Jul 17 17:03:51.783881 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:51.783882    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"}
Jul 17 17:03:51.784426 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:51.783947    2558 scope.go:117] "RemoveContainer" containerID="eabaeabb2834df04cbc8d5dda9d06549aa2b15f9a96ee275ffed66020e813ee7"
Jul 17 17:03:51.784426 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:51.784289    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:03:51.784507 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:51.784474    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:55.181788 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:55.181745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:03:55.182303 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:55.182190    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:03:55.182392 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:55.182368    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:03:58.312835 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:58.312793    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:03:58.313266 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:03:58.313208    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:03:58.313465 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:03:58.313388    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:04:00.409013 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:00.408973    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:04:01.843277 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:01.843241    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4" exitCode=1
Jul 17 17:04:01.843697 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:01.843293    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"}
Jul 17 17:04:01.843697 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:01.843347    2558 scope.go:117] "RemoveContainer" containerID="64369a3b617ad7d69153b6cfee6c7d796a7d861cc11bcc8a7f5e08b2f95cf864"
Jul 17 17:04:01.843697 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:01.843678    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:01.843918 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:01.843892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:04.042212 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:04.042171    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:04:04.042736 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:04.042700    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:04.042925 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:04.042901    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:06.640017 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:06.639981    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:04:06.640439 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:06.640403    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:06.640581 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:06.640561    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:12.409395 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:12.409356    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:04:12.409880 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:12.409598    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:04:19.408887 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:19.408846    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:19.409412 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:19.409024    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:25.412101 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:25.412072    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:04:25.412563 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:25.412276    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:04:34.408782 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:34.408752    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:34.409198 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:34.408930    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:40.408806 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:40.408775    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:04:40.409246 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:40.408943    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:04:47.408726 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:47.408691    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:04:47.409223 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:47.408896    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:04:55.411779 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:04:55.411706    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:04:55.412174 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:04:55.411929    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:05:02.409332 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:02.409298    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:05:02.409742 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:02.409484    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:05:09.409276 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:09.409238    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:05:09.409664 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:09.409457    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:05:13.408757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:13.408721    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:05:13.409195 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:13.408903    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:05:20.408759 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:20.408723    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:05:20.409249 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:20.408910    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:05:27.414406 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:27.414377    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:05:27.414789 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:27.414550    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:05:32.409111 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:32.409077    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:05:32.409524 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:32.409312    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:05:39.408864 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:39.408827    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:05:39.409306 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:39.409020    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:05:43.409055 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:43.409020    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:05:43.409465 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:43.409320    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:05:54.408630 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:54.408594    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:05:54.409097 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:54.408759    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:05:57.408553 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:05:57.408516    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:05:57.408947 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:05:57.408752    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:06:05.529893 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:05.529858    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:06:05.536812 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:05.536790    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:06:08.409220 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:08.409183    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:06:08.409639 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:08.409400    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:06:12.408578 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:12.408544    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:06:12.408998 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:12.408711    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:06:22.409220 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:22.409178    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:06:22.409677 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:22.409414    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:06:26.408654 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:26.408576    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:06:26.409100 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:26.408766    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:06:34.408882 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:34.408847    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:06:34.409391 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:34.409083    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:06:41.409325 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:41.409286    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:06:41.409807 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:41.409442    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:06:45.412043 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:45.412006    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:06:46.695831 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:46.695800    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532" exitCode=1
Jul 17 17:06:46.696321 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:46.695885    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"}
Jul 17 17:06:46.696321 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:46.695947    2558 scope.go:117] "RemoveContainer" containerID="5fa447395f67fc07602ee31d649ef8e2190837220e106181b7e69b782c8096b4"
Jul 17 17:06:46.696480 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:46.696450    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:06:46.696712 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:46.696656    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:06:49.042708 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:49.042663    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:06:49.043167 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:49.043050    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:06:49.043266 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:49.043245    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:06:55.412145 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:55.412099    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:06:55.412641 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:55.412357    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:06:56.639773 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:56.639733    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:06:56.640320 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:06:56.640306    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:06:56.640542 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:06:56.640517    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:07:07.409297 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:07.409258    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:07:07.409767 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:07.409452    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:07:09.408669 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:09.408632    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:07:09.409087 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:09.408789    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:07:19.408814 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:19.408776    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:07:19.409264 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:19.408964    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:07:23.408621 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:23.408585    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:07:23.409012 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:23.408828    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:07:34.408860 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:34.408827    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:07:34.409309 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:34.408939    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:07:34.409309 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:34.409018    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:07:34.409309 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:34.409084    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:07:46.408627 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:46.408591    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:07:46.409234 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:46.408784    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:07:47.408910 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:47.408878    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:07:47.409349 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:47.409091    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:07:58.409502 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:58.409420    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:07:58.409896 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:58.409636    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:07:59.414498 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:07:59.414468    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:07:59.414899 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:07:59.414655    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:08:11.408720 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:11.408674    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:08:11.411188 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:11.408905    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:08:13.409111 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:13.409077    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:08:13.409535 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:13.409307    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:08:25.412137 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:25.412103    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:08:25.412607 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:25.412304    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:08:26.409075 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:26.409044    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:08:26.409278 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:26.409245    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:08:37.409352 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:37.409318    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:08:37.409763 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:37.409472    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:08:39.408845 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:39.408803    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:08:39.409254 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:39.409005    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:08:52.409095 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:52.409060    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:08:52.409499 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:52.409380    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:08:53.358588 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:53.358481    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798" exitCode=1
Jul 17 17:08:53.358588 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:53.358528    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"}
Jul 17 17:08:53.358812 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:53.358591    2558 scope.go:117] "RemoveContainer" containerID="fcf184982afffb2eaeb9c1a05041efd47ebc13f5d124f99b077b122529d9a275"
Jul 17 17:08:53.358995 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:53.358976    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:08:53.359262 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:53.359240    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:08:54.409449 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:54.409409    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:08:54.409854 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:54.409567    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:08:55.181786 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:55.181755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:08:55.182174 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:55.182158    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:08:55.182351 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:55.182331    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:08:58.312657 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:58.312614    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:08:58.313170 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:08:58.313016    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:08:58.313232 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:08:58.313213    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:09:09.409041 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:09.409011    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:09:09.409588 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:09.409225    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:09:13.409228 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:13.409189    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:09:13.409719 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:13.409372    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:09:23.409653 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:23.409613    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:09:23.410045 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:23.409815    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:09:26.408553 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:26.408469    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:09:26.408933 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:26.408657    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:09:36.409191 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:36.409120    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:09:36.409664 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:36.409325    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:09:37.408848 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:37.408811    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:09:37.409085 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:37.409060    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:09:50.409408 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:50.409374    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:09:50.409816 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:09:50.409473    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:09:50.409816 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:50.409563    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:09:50.409816 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:09:50.409616    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:10:01.408932 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:01.408895    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:10:01.409354 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:01.409172    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:10:03.409421 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:03.409380    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:10:03.409817 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:03.409622    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:10:13.409116 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:13.409078    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:10:13.409611 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:13.409301    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:10:14.409103 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:14.409062    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:10:14.409330 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:14.409301    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:10:26.409332 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:26.409298    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:10:26.409755 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:26.409510    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:10:27.408561 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:27.408525    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:10:27.408784 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:27.408722    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:10:39.409422 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:39.409385    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:10:39.409827 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:39.409610    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:10:40.409025 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:40.408990    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:10:40.409254 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:40.409196    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:10:50.409475 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:50.409442    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:10:50.409937 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:50.409636    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:10:51.414871 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:10:51.414841    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:10:51.415311 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:10:51.415015    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:04.408549 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:04.408464    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:11:04.408951 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:04.408644    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:05.411401 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:05.411371    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:05.411818 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:05.411594    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:11:05.563654 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:05.563622    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:11:05.571764 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:05.571738    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:11:17.409069 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:17.409037    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:17.409517 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:17.409230    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:11:18.409486 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:18.409448    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:11:18.409884 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:18.409634    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:29.409364 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:29.409323    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:11:29.409979 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:29.409534    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:31.409091 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:31.409061    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:31.409518 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:31.409293    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:11:42.409341 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:42.409312    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:42.409739 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:42.409489    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:11:44.408688 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:44.408651    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:11:44.409097 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:44.408837    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:56.408768 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:56.408733    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:57.334740 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:57.334706    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e" exitCode=1
Jul 17 17:11:57.334929 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:57.334749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"}
Jul 17 17:11:57.334929 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:57.334797    2558 scope.go:117] "RemoveContainer" containerID="902da683b34d718f1574b0cb8837fe8592838179c75f443e424c1b0341b7f532"
Jul 17 17:11:57.335168 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:57.335148    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:11:57.335369 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:57.335347    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:11:57.408717 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:57.408683    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:11:57.408909 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:57.408886    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:11:59.043029 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:59.042991    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:11:59.043484 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:11:59.043471    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:11:59.043665 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:11:59.043643    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:12:06.640445 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:06.640384    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:12:06.641072 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:06.640849    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:12:06.641170 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:06.641068    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:12:11.408509 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:11.408478    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:12:11.408972 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:11.408716    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:12:19.409416 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:19.409383    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:12:19.409815 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:19.409554    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:12:22.408761 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:22.408724    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:12:22.409198 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:22.408924    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:12:34.408992 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:34.408907    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:12:34.409418 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:34.409099    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:12:37.408757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:37.408724    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:12:37.409292 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:37.408883    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:12:48.409291 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:48.409252    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:12:48.409866 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:48.409523    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:12:50.409489 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:12:50.409451    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:12:50.409885 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:12:50.409623    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:01.408687 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:01.408651    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:01.409082 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:01.408816    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:02.408756 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:02.408724    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:13:02.409189 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:02.408892    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:13:14.408897 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:14.408859    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:13:14.409370 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:14.409062    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:13:15.411324 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:15.411286    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:15.411770 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:15.411527    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:27.409006 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:27.408968    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:27.409524 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:27.409242    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:28.408943 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:28.408899    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:13:28.409197 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:28.409159    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:13:39.409531 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:39.409490    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:39.410027 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:39.409681    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:40.409345 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:40.409313    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:13:40.409543 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:40.409485    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:13:53.408985 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:53.408954    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:53.409404 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:53.409288    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:13:53.956271 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:53.956179    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerStarted","Data":"f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"}
Jul 17 17:13:53.956431 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:53.956411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:13:54.408957 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:54.408915    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:13:54.409174 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:54.409097    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:13:54.962945 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:54.962901    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e" exitCode=1
Jul 17 17:13:54.963099 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:54.962959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"}
Jul 17 17:13:54.963099 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:54.963023    2558 scope.go:117] "RemoveContainer" containerID="f9fd0f76d00b9496e565a0b8cec7b0fe6fb698b3847dfb1fe0cfbfc55156c798"
Jul 17 17:13:54.963315 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:54.963295    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:13:54.963526 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:54.963505    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:55.969835 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:55.969805    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:13:55.970318 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:55.970044    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:13:58.312434 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:58.312395    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:13:58.312940 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:13:58.312787    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:13:58.312983 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:13:58.312952    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:14:05.412672 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:05.412635    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:14:05.413232 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:05.412843    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:14:13.409550 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:13.409510    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:14:13.410054 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:13.409706    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:14:19.408962 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:19.408921    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:14:19.409401 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:19.409113    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:14:25.413395 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:25.413359    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:14:25.413852 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:25.413643    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:14:34.409427 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:34.409392    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:14:34.409911 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:34.409601    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:14:38.408794 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:38.408762    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:14:38.409215 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:38.408914    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:14:47.409380 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:47.409345    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:14:47.409764 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:47.409537    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:14:49.408851 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:49.408820    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:14:49.409246 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:49.408973    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:14:58.409415 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:14:58.409379    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:14:58.409889 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:14:58.409624    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:15:02.409203 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:02.409169    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:15:02.409603 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:02.409348    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:15:09.409626 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:09.409586    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:15:09.410202 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:09.409760    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:15:15.412017 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:15.411981    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:15:15.412533 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:15.412184    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:15:23.409361 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:23.409323    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:15:23.409817 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:23.409544    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:15:29.408866 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:29.408834    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:15:29.409299 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:29.409016    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:15:38.408919 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:38.408885    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:15:38.409335 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:38.409068    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:15:42.409273 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:42.409240    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:15:42.409770 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:42.409403    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:15:52.409366 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:52.409331    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:15:52.409769 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:52.409525    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:15:53.408986 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:15:53.408955    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:15:53.409205 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:15:53.409181    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:16:03.409429 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:03.409393    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:16:03.409834 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:03.409578    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:16:05.414984 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:05.414953    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:16:05.415369 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:05.415099    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:16:05.597542 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:05.597512    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:16:05.605992 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:05.605967    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:16:16.409419 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:16.409388    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:16:16.409849 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:16.409535    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:16:18.409295 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:18.409262    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:16:18.409691 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:18.409471    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:16:28.409210 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:28.409174    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:16:28.409610 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:28.409376    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:16:30.408471 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:30.408432    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:16:30.408876 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:30.408622    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:16:41.409593 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:41.409562    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:16:41.410009 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:41.409727    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:16:44.408655 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:44.408623    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:16:44.409093 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:44.408796    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:16:54.409078 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:54.409041    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:16:54.409597 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:54.409253    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:16:57.409464 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:16:57.409377    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:16:57.409842 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:16:57.409602    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:17:06.409110 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:06.409071    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:17:07.004194 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:07.004090    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerStarted","Data":"c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"}
Jul 17 17:17:07.004360 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:07.004315    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:17:08.018542 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:08.018505    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67" exitCode=1
Jul 17 17:17:08.018967 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:08.018592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"}
Jul 17 17:17:08.018967 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:08.018670    2558 scope.go:117] "RemoveContainer" containerID="47e816df3450907da720c2727acecfeae02644c2a54f18e3854c15895d53633e"
Jul 17 17:17:08.018967 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:08.018876    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:08.019166 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:08.019069    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:17:09.026343 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:09.026312    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:09.026766 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:09.026525    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:17:12.408606 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:12.408570    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:17:12.408981 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:12.408791    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:17:16.640408 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:16.640365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:17:16.640830 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:16.640751    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:16.640973 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:16.640952    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:17:24.408795 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:24.408762    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:17:24.409339 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:24.408992    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:17:27.409429 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:27.409391    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:27.409973 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:27.409612    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:17:39.408773 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:39.408739    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:17:39.409192 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:39.408922    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:17:42.409022 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:42.408986    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:42.409458 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:42.409229    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:17:50.408845 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:50.408810    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:17:50.409389 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:50.408976    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:17:55.412960 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:17:55.412920    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:17:55.413376 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:17:55.413182    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:01.409571 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:01.409533    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:01.410030 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:01.409707    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:08.409368 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:08.409330    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:18:08.409855 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:08.409519    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:14.408926 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:14.408890    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:14.409404 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:14.409092    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:21.409250 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:21.409214    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:18:21.409689 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:21.409399    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:28.409241 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:28.409153    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:28.409631 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:28.409342    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:32.409218 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:32.409179    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:18:32.409630 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:32.409371    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:42.409278 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:42.409243    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:42.409683 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:42.409442    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:43.415404 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:43.415376    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:18:43.415781 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:43.415512    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:55.411816 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:55.411775    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:55.412386 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:55.412180    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:18:56.598007 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:56.597910    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7" exitCode=1
Jul 17 17:18:56.598007 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:56.597990    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"}
Jul 17 17:18:56.598538 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:56.598061    2558 scope.go:117] "RemoveContainer" containerID="f6de356870e75f17c3695100642179e60caaac74c9e2c05fb7f28481fe8fd59e"
Jul 17 17:18:56.598538 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:56.598402    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:18:56.598642 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:56.598623    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:57.408616 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:57.408579    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:18:57.408873 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:57.408849    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:18:58.312622 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:58.312578    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:18:58.313042 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:58.312936    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:18:58.313156 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:58.313107    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:18:58.956750 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:58.956707    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:18:58.957150 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:18:58.957108    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:18:58.957323 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:18:58.957301    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:19:09.409437 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:09.409398    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:19:09.409849 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:09.409556    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:19:12.408500 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:12.408466    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:19:12.408894 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:12.408674    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:19:20.409217 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:20.409176    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:19:20.409694 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:20.409400    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:19:24.408899 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:24.408866    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:19:24.409351 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:24.409038    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:19:34.408689 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:34.408646    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:19:34.409327 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:34.408885    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:19:38.409231 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:38.409199    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:19:38.409625 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:38.409379    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:19:48.408745 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:48.408714    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:19:48.409195 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:48.408934    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:19:52.409546 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:19:52.409505    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:19:52.409944 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:19:52.409686    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:20:03.408841 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:03.408755    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:20:03.409239 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:03.408927    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:20:07.408989 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:07.408957    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:20:07.409629 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:07.409115    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:20:15.411892 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:15.411859    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:20:15.412317 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:15.412081    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:20:21.408605 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:21.408566    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:20:21.409102 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:21.408748    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:20:27.408696 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:27.408667    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:20:27.409092 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:27.408836    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:20:32.408413 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:32.408380    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:20:32.408813 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:32.408544    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:20:39.409176 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:39.409111    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:20:39.409672 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:39.409334    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:20:44.408715 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:44.408682    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:20:44.409106 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:44.408875    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:20:54.408531 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:54.408500    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:20:54.408929 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:54.408673    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:20:56.409351 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:20:56.409314    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:20:56.409779 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:20:56.409491    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:21:05.630581 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:05.630536    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:21:05.639847 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:05.639824    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:21:07.409289 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:07.409254    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:21:07.409673 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:07.409407    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:21:09.408762 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:09.408726    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:21:09.409181 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:09.408882    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:21:18.408903 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:18.408871    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:21:18.409395 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:18.409056    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:21:23.408926 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:23.408884    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:21:23.409421 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:23.409083    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:21:30.408724 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:30.408629    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:21:30.409209 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:30.408881    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:21:35.411698 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:35.411665    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:21:35.412104 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:35.411858    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:21:42.409384 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:42.409348    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:21:42.409780 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:42.409531    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:21:48.408446 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:48.408411    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:21:48.408930 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:48.408583    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:21:56.408489 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:21:56.408449    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:21:56.408963 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:21:56.408690    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:01.408708 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:01.408664    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:22:01.409104 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:01.408916    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:22:10.408909 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:10.408875    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:22:11.640140 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:11.640095    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb" exitCode=1
Jul 17 17:22:11.640610 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:11.640176    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"}
Jul 17 17:22:11.640610 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:11.640257    2558 scope.go:117] "RemoveContainer" containerID="c8a167c701abe0b2dc61b7e62d7b19fbc0d763c78922bfe080c050a459f21f67"
Jul 17 17:22:11.640734 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:11.640611    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:11.640833 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:11.640813    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:12.004889 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:12.004850    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:22:12.646927 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:12.646901    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:12.647340 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:12.647073    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:15.411650 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:15.411623    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:22:15.412101 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:15.411787    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:22:16.639679 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:16.639640    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:22:16.640107 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:16.640024    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:16.640239 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:16.640220    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:28.408929 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:28.408892    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:22:28.409462 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:28.409073    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:22:29.409264 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:29.409226    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:29.409672 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:29.409476    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:40.408766 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:40.408727    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:22:40.409314 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:40.408912    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:22:41.408796 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:41.408757    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:41.409226 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:41.408989    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:54.409541 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:54.409505    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:22:54.409950 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:54.409721    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:22:55.411604 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:22:55.411521    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:22:55.412161 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:22:55.411715    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:23:07.408880 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:07.408850    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:23:07.409332 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:07.409037    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:23:09.409350 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:09.409308    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:23:09.409846 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:09.409525    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:23:21.408806 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:21.408771    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:23:21.411203 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:21.408925    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:23:22.409267 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:22.409232    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:23:22.409665 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:22.409416    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:23:34.408684 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:34.408652    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:23:34.409075 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:34.408849    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:23:36.409316 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:36.409282    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:23:36.409696 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:36.409437    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:23:47.408596 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:47.408562    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:23:47.409194 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:23:47.408656    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:23:47.409194 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:47.408787    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:23:47.409194 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:23:47.408801    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:24:01.408784 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:01.408746    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:24:01.409414 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:01.409078    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:24:02.225090 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:02.225054    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83" exitCode=1
Jul 17 17:24:02.225275 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:02.225096    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"}
Jul 17 17:24:02.225275 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:02.225186    2558 scope.go:117] "RemoveContainer" containerID="f09ea46d8dcef360864987dc4b9207651d0231896cfb5e84978fd81bb6e840d7"
Jul 17 17:24:02.225527 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:02.225481    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:02.225782 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:02.225755    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:02.409323 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:02.409300    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:24:02.409689 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:02.409481    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:24:03.956785 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:03.956746    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:24:03.957250 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:03.957158    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:03.957345 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:03.957325    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:08.312707 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:08.312667    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:24:08.313222 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:08.313049    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:08.313281 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:08.313250    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:17.408701 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:17.408668    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:24:17.409096 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:17.408856    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:24:20.409101 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:20.409063    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:20.409510 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:20.409268    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:30.408540 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:30.408503    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:24:30.408926 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:30.408703    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:24:33.409084 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:33.409049    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:33.409589 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:33.409310    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:45.412193 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:45.412155    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:24:45.412732 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:45.412405    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:24:48.408676 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:48.408637    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:24:48.409080 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:48.408840    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:24:57.409092 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:24:57.409059    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:24:57.409515 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:24:57.409242    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:25:00.409203 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:00.409171    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:25:00.409591 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:00.409379    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:25:12.408585 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:12.408552    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:25:12.408953 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:12.408729    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:25:15.411739 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:15.411713    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:25:15.412298 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:15.411902    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:25:24.408856 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:24.408809    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:25:24.409469 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:24.409083    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:25:27.409380 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:27.409345    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:25:27.409812 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:27.409583    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:25:38.409416 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:38.409376    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:25:38.409833 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:38.409499    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:25:38.409833 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:38.409561    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:25:38.409833 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:38.409638    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:25:51.410058 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:51.410024    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:25:51.410522 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:25:51.410163    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:25:51.410522 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:51.410231    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:25:51.410522 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:25:51.410332    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:04.409249 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:04.409216    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:26:04.409682 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:04.409387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:26:05.663776 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:05.663742    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:26:05.673157 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:05.673111    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:26:06.409014 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:06.408982    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:26:06.409217 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:06.409180    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:18.409234 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:18.409200    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:26:18.409708 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:18.409379    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:19.409437 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:19.409399    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:26:19.409947 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:19.409580    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:26:29.409262 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:29.409223    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:26:29.409736 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:29.409454    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:30.408870 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:30.408828    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:26:30.409058 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:30.408982    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:26:41.409414 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:41.409371    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:26:41.409937 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:41.409579    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:43.408778 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:43.408744    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:26:43.409214 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:43.408918    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:26:54.409413 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:54.409378    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:26:54.409866 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:54.409535    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:26:57.409246 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:26:57.409206    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:26:57.409709 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:26:57.409448    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:27:07.408844 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:07.408811    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:27:07.409256 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:07.408990    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:27:11.408757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:11.408727    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:27:11.409268 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:11.408888    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:27:20.409366 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:20.409331    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:27:21.264705 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:21.264667    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12" exitCode=1
Jul 17 17:27:21.265036 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:21.264719    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"}
Jul 17 17:27:21.265036 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:21.264773    2558 scope.go:117] "RemoveContainer" containerID="4a348ffe1ef0715528456949e0dc3ab66f3cb44cb29f9d7532fcb2774ad8dddb"
Jul 17 17:27:21.265187 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:21.265152    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:27:21.265364 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:21.265340    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:27:22.004608 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:22.004571    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:27:22.271757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:22.271678    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:27:22.271904 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:22.271848    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:27:22.409035 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:22.408999    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:27:22.409252 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:22.409219    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:27:26.640290 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:26.640187    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:27:26.640755 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:26.640587    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:27:26.640801 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:26.640757    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:27:37.409115 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:37.409081    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:27:37.409628 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:37.409362    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:27:41.409142 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:41.409109    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:27:41.409523 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:41.409326    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:27:50.408674 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:50.408638    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:27:50.409103 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:50.408870    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:27:56.408761 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:27:56.408724    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:27:56.409289 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:27:56.409109    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:28:03.408678 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:03.408648    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:28:03.409177 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:03.408819    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:28:10.408699 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:10.408664    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:28:10.409109 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:10.408875    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:28:17.408918 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:17.408872    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:28:17.409356 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:17.409094    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:28:25.411288 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:25.411255    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:28:25.413648 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:25.411459    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:28:30.408479 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:30.408441    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:28:30.408874 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:30.408622    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:28:40.409078 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:40.409047    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:28:40.409607 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:40.409252    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:28:41.409196 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:41.409157    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:28:41.409663 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:41.409399    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:28:51.409287 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:51.409248    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:28:51.409686 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:51.409470    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:28:53.408937 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:28:53.408905    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:28:53.409345 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:28:53.409097    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:01.043902 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.043813    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:29:01.047476 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.047454    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.049711 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.049685    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-f748a7-serving-cert\""
Jul 17 17:29:01.057945 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.057915    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:29:01.168659 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.168622    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79k7s\" (UniqueName: \"kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.168898 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.168674    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.168898 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.168823    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.270330 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.270292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.270547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.270355    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79k7s\" (UniqueName: \"kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.270547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.270382    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.271022 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.271006    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.272943 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.272918    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.279311 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.279287    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79k7s\" (UniqueName: \"kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s\") pod \"maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.359694 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.359593    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:01.505665 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.505631    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:29:01.507322 ip-10-0-134-12 kubenswrapper[2558]: W0717 17:29:01.507296    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7ecf282_a799_4252_adf8_fa3b9286503f.slice/crio-0eb35a38cd1c1a35c5197efdc1641a416022af4ca0989a93f7f214f5b57aa681 WatchSource:0}: Error finding container 0eb35a38cd1c1a35c5197efdc1641a416022af4ca0989a93f7f214f5b57aa681: Status 404 returned error can't find the container with id 0eb35a38cd1c1a35c5197efdc1641a416022af4ca0989a93f7f214f5b57aa681
Jul 17 17:29:01.508612 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.508592    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:29:01.820180 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:01.820117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" event={"ID":"c7ecf282-a799-4252-adf8-fa3b9286503f","Type":"ContainerStarted","Data":"0eb35a38cd1c1a35c5197efdc1641a416022af4ca0989a93f7f214f5b57aa681"}
Jul 17 17:29:02.827009 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:02.826966    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" event={"ID":"c7ecf282-a799-4252-adf8-fa3b9286503f","Type":"ContainerStarted","Data":"20fd98abf57efe4d133898c93669c7b749b41cec65eaa7241fc452a6a58af384"}
Jul 17 17:29:02.827471 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:02.827107    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:02.846047 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:02.845997    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" podStartSLOduration=1.4505403270000001 podStartE2EDuration="1.845980925s" totalImagesPullingTime="395.440598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:29:02.845170383 +0000 UTC m=+3777.957712980" watchObservedRunningTime="2026-07-17 17:29:02.845980925 +0000 UTC m=+3777.958523500"
Jul 17 17:29:05.413532 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:05.413494    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:29:05.413975 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:05.413722    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:29:07.409314 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:07.409278    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:29:08.838266 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.838236    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:29:08.860650 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.860614    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9" exitCode=1
Jul 17 17:29:08.860650 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.860651    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"}
Jul 17 17:29:08.860855 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.860697    2558 scope.go:117] "RemoveContainer" containerID="9f376dd82dff5b2e3932985294dc01ff8cf2390cef247cea3dcc881a1094fd83"
Jul 17 17:29:08.861060 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.861041    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:08.861268 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:08.861250    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:08.956805 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:08.956767    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:29:09.867703 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:09.867676    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:09.868084 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:09.867842    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:17.409151 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:17.409090    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:29:17.409597 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:17.409344    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:29:18.312846 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:18.312804    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:29:18.313459 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:18.313434    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:18.313671 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:18.313647    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:31.409579 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:31.409539    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:29:31.409987 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:31.409605    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:31.409987 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:31.409765    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:31.409987 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:31.409771    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:29:44.409481 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:44.409448    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:44.409875 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:44.409632    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:29:45.411889 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:45.411771    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:29:45.412497 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:45.411988    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:29:56.408863 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:56.408824    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:29:56.409329 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:56.409023    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:29:59.409272 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:29:59.409234    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:29:59.409768 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:29:59.409444    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:30:04.252855 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:04.252814    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"]
Jul 17 17:30:04.254956 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:04.254931    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29738445-6l9np"]
Jul 17 17:30:05.415064 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:05.415026    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b732cc12-746f-4cbf-9c80-68baf65ec343" path="/var/lib/kubelet/pods/b732cc12-746f-4cbf-9c80-68baf65ec343/volumes"
Jul 17 17:30:05.762476 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:05.762390    2558 scope.go:117] "RemoveContainer" containerID="b9405e93dffeadd61470d29b7a869e500aeb0174abb2f7c403eca5db7f3e6d87"
Jul 17 17:30:08.408806 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:08.408769    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:30:08.409311 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:08.408995    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:30:12.408651 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:12.408611    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:30:12.409061 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:12.408865    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:30:22.124083 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.124048    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:30:22.124598 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.124277    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" podUID="c7ecf282-a799-4252-adf8-fa3b9286503f" containerName="maas-api" containerID="cri-o://20fd98abf57efe4d133898c93669c7b749b41cec65eaa7241fc452a6a58af384" gracePeriod=30
Jul 17 17:30:22.250314 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.250282    2558 generic.go:356] "Generic (PLEG): container finished" podID="c7ecf282-a799-4252-adf8-fa3b9286503f" containerID="20fd98abf57efe4d133898c93669c7b749b41cec65eaa7241fc452a6a58af384" exitCode=0
Jul 17 17:30:22.250456 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.250351    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" event={"ID":"c7ecf282-a799-4252-adf8-fa3b9286503f","Type":"ContainerDied","Data":"20fd98abf57efe4d133898c93669c7b749b41cec65eaa7241fc452a6a58af384"}
Jul 17 17:30:22.380439 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.380371    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:30:22.409266 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.409236    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:30:22.409433 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:22.409418    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:30:22.471347 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.471306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79k7s\" (UniqueName: \"kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s\") pod \"c7ecf282-a799-4252-adf8-fa3b9286503f\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") "
Jul 17 17:30:22.471529 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.471377    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls\") pod \"c7ecf282-a799-4252-adf8-fa3b9286503f\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") "
Jul 17 17:30:22.471529 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.471438    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca\") pod \"c7ecf282-a799-4252-adf8-fa3b9286503f\" (UID: \"c7ecf282-a799-4252-adf8-fa3b9286503f\") "
Jul 17 17:30:22.471835 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.471804    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7ecf282-a799-4252-adf8-fa3b9286503f" (UID: "c7ecf282-a799-4252-adf8-fa3b9286503f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:30:22.473835 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.473813    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7ecf282-a799-4252-adf8-fa3b9286503f" (UID: "c7ecf282-a799-4252-adf8-fa3b9286503f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:30:22.473921 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.473811    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s" (OuterVolumeSpecName: "kube-api-access-79k7s") pod "c7ecf282-a799-4252-adf8-fa3b9286503f" (UID: "c7ecf282-a799-4252-adf8-fa3b9286503f"). InnerVolumeSpecName "kube-api-access-79k7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:30:22.573164 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.573109    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7ecf282-a799-4252-adf8-fa3b9286503f-maas-api-tls\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:30:22.573164 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.573162    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7ecf282-a799-4252-adf8-fa3b9286503f-openshift-service-ca\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:30:22.573164 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:22.573172    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79k7s\" (UniqueName: \"kubernetes.io/projected/c7ecf282-a799-4252-adf8-fa3b9286503f-kube-api-access-79k7s\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:30:23.256773 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.256746    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"
Jul 17 17:30:23.257210 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.256737    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d" event={"ID":"c7ecf282-a799-4252-adf8-fa3b9286503f","Type":"ContainerDied","Data":"0eb35a38cd1c1a35c5197efdc1641a416022af4ca0989a93f7f214f5b57aa681"}
Jul 17 17:30:23.257210 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.256922    2558 scope.go:117] "RemoveContainer" containerID="20fd98abf57efe4d133898c93669c7b749b41cec65eaa7241fc452a6a58af384"
Jul 17 17:30:23.278459 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.278429    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:30:23.281576 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.281551    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-f748a7-77d7994b8d-lzb4d"]
Jul 17 17:30:23.409345 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.409312    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:30:23.409518 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:23.409488    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:30:23.416162 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:23.416113    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7ecf282-a799-4252-adf8-fa3b9286503f" path="/var/lib/kubelet/pods/c7ecf282-a799-4252-adf8-fa3b9286503f/volumes"
Jul 17 17:30:33.409430 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:33.409345    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:30:33.409828 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:33.409486    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:30:34.409273 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:34.409242    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:30:34.409474 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:34.409407    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:30:45.411891 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.411854    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:30:45.412356 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:45.412077    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:30:45.710547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.710465    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:30:45.710911 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.710897    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7ecf282-a799-4252-adf8-fa3b9286503f" containerName="maas-api"
Jul 17 17:30:45.710958 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.710917    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7ecf282-a799-4252-adf8-fa3b9286503f" containerName="maas-api"
Jul 17 17:30:45.711001 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.710990    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7ecf282-a799-4252-adf8-fa3b9286503f" containerName="maas-api"
Jul 17 17:30:45.714116 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.714098    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.716413 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.716370    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-47d559-serving-cert\""
Jul 17 17:30:45.727341 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.727309    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:30:45.894288 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.894252    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.894487 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.894321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.894487 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.894355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfzc\" (UniqueName: \"kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.995233 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.995102    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.995233 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.995192    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfzc\" (UniqueName: \"kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.995429 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.995262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:45.995429 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:45.995358    2558 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-serving-cert: secret "maas-api-e2e-api-b-47d559-serving-cert" not found
Jul 17 17:30:45.995499 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:45.995434    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls podName:cbbe7ed0-92c3-4093-a553-c96b6fc98b58 nodeName:}" failed. No retries permitted until 2026-07-17 17:30:46.49541397 +0000 UTC m=+3881.607956525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls") pod "maas-api-e2e-api-b-47d559-664f87cc94-6j94s" (UID: "cbbe7ed0-92c3-4093-a553-c96b6fc98b58") : secret "maas-api-e2e-api-b-47d559-serving-cert" not found
Jul 17 17:30:45.995849 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:45.995828    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:46.005295 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:46.005257    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfzc\" (UniqueName: \"kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:46.502190 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:46.502111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:46.504837 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:46.504810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") pod \"maas-api-e2e-api-b-47d559-664f87cc94-6j94s\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:46.625315 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:46.625266    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:46.768855 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:46.768828    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:30:46.770953 ip-10-0-134-12 kubenswrapper[2558]: W0717 17:30:46.770929    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbe7ed0_92c3_4093_a553_c96b6fc98b58.slice/crio-bdbba74ed94b4850cfc442472691e03d3ca9faa4dada65e401182d134afd6ac8 WatchSource:0}: Error finding container bdbba74ed94b4850cfc442472691e03d3ca9faa4dada65e401182d134afd6ac8: Status 404 returned error can't find the container with id bdbba74ed94b4850cfc442472691e03d3ca9faa4dada65e401182d134afd6ac8
Jul 17 17:30:47.381688 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:47.381646    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" event={"ID":"cbbe7ed0-92c3-4093-a553-c96b6fc98b58","Type":"ContainerStarted","Data":"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"}
Jul 17 17:30:47.381870 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:47.381712    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" event={"ID":"cbbe7ed0-92c3-4093-a553-c96b6fc98b58","Type":"ContainerStarted","Data":"bdbba74ed94b4850cfc442472691e03d3ca9faa4dada65e401182d134afd6ac8"}
Jul 17 17:30:47.381870 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:47.381745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:30:47.401382 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:47.401322    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" podStartSLOduration=1.950829314 podStartE2EDuration="2.401305889s" totalImagesPullingTime="450.476575ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:30:47.399573793 +0000 UTC m=+3882.512116392" watchObservedRunningTime="2026-07-17 17:30:47.401305889 +0000 UTC m=+3882.513848464"
Jul 17 17:30:49.408924 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:49.408872    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:30:49.409436 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:30:49.409168    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:30:53.392551 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:30:53.392522    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:31:00.409293 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:00.409251    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:31:00.409694 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:00.409409    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:31:01.409153 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:01.409095    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:31:01.409386 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:01.409360    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:31:05.702318 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:05.702285    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:31:05.712325 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:05.712300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:31:13.409053 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:13.409018    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:31:13.409478 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:13.409227    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:31:14.409432 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:14.409399    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:31:14.409792 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:14.409594    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:31:27.409021 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:27.408980    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:31:27.409658 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:27.409210    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:31:28.409354 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:28.409317    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:31:28.409822 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:28.409567    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:31:41.031819 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.031777    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:31:41.032261 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.032079    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" podUID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" containerName="maas-api" containerID="cri-o://fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310" gracePeriod=30
Jul 17 17:31:41.284897 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.284828    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:31:41.392023 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.391980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") pod \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") "
Jul 17 17:31:41.392266 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.392078    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnfzc\" (UniqueName: \"kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc\") pod \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") "
Jul 17 17:31:41.392266 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.392101    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca\") pod \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\" (UID: \"cbbe7ed0-92c3-4093-a553-c96b6fc98b58\") "
Jul 17 17:31:41.392495 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.392473    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbbe7ed0-92c3-4093-a553-c96b6fc98b58" (UID: "cbbe7ed0-92c3-4093-a553-c96b6fc98b58"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:31:41.394308 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.394283    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbbe7ed0-92c3-4093-a553-c96b6fc98b58" (UID: "cbbe7ed0-92c3-4093-a553-c96b6fc98b58"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:31:41.394412 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.394395    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc" (OuterVolumeSpecName: "kube-api-access-fnfzc") pod "cbbe7ed0-92c3-4093-a553-c96b6fc98b58" (UID: "cbbe7ed0-92c3-4093-a553-c96b6fc98b58"). InnerVolumeSpecName "kube-api-access-fnfzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:31:41.414932 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.414907    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:31:41.415108 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:41.415084    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:31:41.493608 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.493567    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnfzc\" (UniqueName: \"kubernetes.io/projected/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-kube-api-access-fnfzc\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:31:41.493608 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.493599    2558 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-openshift-service-ca\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:31:41.493608 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.493609    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbbe7ed0-92c3-4093-a553-c96b6fc98b58-maas-api-tls\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:31:41.676501 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.676470    2558 generic.go:356] "Generic (PLEG): container finished" podID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" containerID="fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310" exitCode=0
Jul 17 17:31:41.676693 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.676516    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"
Jul 17 17:31:41.676693 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.676522    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" event={"ID":"cbbe7ed0-92c3-4093-a553-c96b6fc98b58","Type":"ContainerDied","Data":"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"}
Jul 17 17:31:41.676693 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.676565    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s" event={"ID":"cbbe7ed0-92c3-4093-a553-c96b6fc98b58","Type":"ContainerDied","Data":"bdbba74ed94b4850cfc442472691e03d3ca9faa4dada65e401182d134afd6ac8"}
Jul 17 17:31:41.676693 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.676585    2558 scope.go:117] "RemoveContainer" containerID="fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"
Jul 17 17:31:41.686101 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.686079    2558 scope.go:117] "RemoveContainer" containerID="fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"
Jul 17 17:31:41.686427 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:41.686400    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310\": container with ID starting with fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310 not found: ID does not exist" containerID="fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"
Jul 17 17:31:41.686482 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.686437    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310"} err="failed to get container status \"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310\": rpc error: code = NotFound desc = could not find container \"fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310\": container with ID starting with fa50ba6ad83e229433e2f68a3fb024827cdb5f63e11a370c42cebf1733230310 not found: ID does not exist"
Jul 17 17:31:41.694474 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.694440    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:31:41.697881 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:41.697853    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-47d559-664f87cc94-6j94s"]
Jul 17 17:31:42.408863 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:42.408830    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:31:42.409327 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:42.409014    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:31:43.414858 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:43.414822    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" path="/var/lib/kubelet/pods/cbbe7ed0-92c3-4093-a553-c96b6fc98b58/volumes"
Jul 17 17:31:52.409305 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:52.409265    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:31:52.409712 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:52.409463    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:31:53.409281 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:31:53.409249    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:31:53.409458 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:31:53.409414    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:32:05.411564 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:05.411479    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:32:05.412353 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:05.411692    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:32:06.408566 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:06.408531    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:32:06.408752 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:06.408707    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:18.408773 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:18.408729    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:32:18.409305 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:18.408949    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:32:19.409405 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:19.409369    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:32:19.409934 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:19.409552    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:30.408987 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:30.408949    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:32:31.408766 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:31.408730    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:32:31.408937 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:31.408921    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:32:31.938313 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:31.938277    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25" exitCode=1
Jul 17 17:32:31.938803 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:31.938352    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"}
Jul 17 17:32:31.938803 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:31.938420    2558 scope.go:117] "RemoveContainer" containerID="2c3c9205b26348d4e2041890944336c804e51b716018648f1d8831fc4d669b12"
Jul 17 17:32:31.938803 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:31.938763    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:32:31.939004 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:31.938983    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:32.005305 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:32.005263    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:32:32.947479 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:32.947457    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:32:32.947843 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:32.947618    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:36.639906 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:36.639847    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:32:36.640552 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:36.640334    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:32:36.640552 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:36.640500    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:43.409318 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:43.409284    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:32:43.409708 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:43.409438    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:32:51.409636 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:51.409594    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:32:51.410051 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:51.409846    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:32:56.409504 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:32:56.409467    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:32:56.409911 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:32:56.409657    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:33:04.408901 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:04.408864    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:33:04.409329 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:04.409056    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:33:07.408905 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:07.408867    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:33:07.409319 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:07.409033    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:33:16.409386 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:16.409347    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:33:16.409930 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:16.409549    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:33:20.408642 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:20.408609    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:33:20.409031 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:20.408800    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:33:28.409393 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:28.409359    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:33:28.411628 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:28.409536    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:33:33.408560 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:33.408522    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:33:33.408997 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:33.408708    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:33:43.409318 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:43.409282    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:33:43.409718 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:43.409491    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:33:48.409402 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:48.409370    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:33:48.409864 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:48.409535    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:33:55.412318 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:33:55.412285    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:33:55.413144 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:33:55.413092    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:34:00.409307 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:00.409269    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:34:00.409769 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:00.409465    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:09.409295 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:09.409257    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:34:09.409795 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:09.409442    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:34:11.409094 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:11.409061    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:34:11.409519 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:11.409390    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:34:12.462625 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:12.462593    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac" exitCode=1
Jul 17 17:34:12.463101 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:12.462672    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"}
Jul 17 17:34:12.463101 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:12.462749    2558 scope.go:117] "RemoveContainer" containerID="89f4baaf5e8ad9a222c86629fc5abdf1a15a5b4bff2a180974c32ddea3e346f9"
Jul 17 17:34:12.463255 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:12.463168    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:12.463388 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:12.463363    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:13.956457 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:13.956427    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:34:13.956887 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:13.956789    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:13.956971 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:13.956952    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:18.313019 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:18.312984    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:34:18.313527 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:18.313505    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:18.313837 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:18.313800    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:24.409718 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:24.409674    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:34:24.410224 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:24.409876    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:34:29.409298 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:29.409262    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:29.409702 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:29.409454    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:39.408700 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:39.408659    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:34:39.409260 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:39.408831    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:34:42.408678 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:42.408638    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:42.409188 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:42.408918    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:34:53.409308 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:53.409274    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:34:53.409775 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:53.409483    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:34:54.408966 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:34:54.408930    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:34:54.409205 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:34:54.409108    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:05.412566 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:05.412474    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:35:05.413344 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:05.413317    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:06.408865 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:06.408831    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:35:06.409048 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:06.409002    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:35:17.409306 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:17.409269    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:35:17.409697 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:17.409390    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:35:17.409697 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:17.409492    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:17.409697 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:17.409541    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:35:31.409276 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:31.409244    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:35:31.409696 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:31.409326    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:35:31.409696 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:31.409435    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:35:31.409696 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:31.409458    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:46.408973 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:46.408939    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:35:46.409522 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:46.409051    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:35:46.409522 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:46.409109    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:35:46.409522 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:46.409211    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:59.408938 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:59.408896    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:35:59.409390 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:35:59.409041    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:35:59.409390 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:59.409163    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:35:59.409390 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:35:59.409242    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:36:05.736689 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:05.736656    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:36:05.748852 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:05.748829    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mjwb8_2bd52190-ca3b-4aff-a812-e11908b5b960/ovn-acl-logging/0.log"
Jul 17 17:36:11.409682 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:11.409649    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:36:11.410094 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:11.409811    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:36:12.409454 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:12.409421    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:36:12.409638 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:12.409596    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:36:23.409530 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:23.409495    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:36:23.410016 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:23.409664    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:36:25.411452 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:25.411368    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:36:25.411903 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:25.411621    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:36:36.409455 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:36.409421    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:36:36.409871 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:36.409634    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:36:38.408651 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:38.408617    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:36:38.409053 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:38.408796    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:36:50.409342 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:50.409306    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:36:50.409755 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:50.409496    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:36:51.409271 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:36:51.409240    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:36:51.409451 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:36:51.409394    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:04.409016 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:04.408985    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:37:04.409533 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:04.409078    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:37:04.409533 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:04.409200    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:04.409533 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:04.409270    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:16.408665 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:16.408631    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:37:16.409100 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:16.408676    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:37:16.409100 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:16.408824    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:16.409100 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:16.408846    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:27.409633 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:27.409603    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:37:27.410042 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:27.409762    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:31.408930 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:31.408895    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:37:31.409359 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:31.409197    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:40.409188 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:40.409116    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:37:41.567089 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:41.566997    2558 generic.go:356] "Generic (PLEG): container finished" podID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b" exitCode=1
Jul 17 17:37:41.567089 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:41.567066    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" event={"ID":"249b1bb3-16f3-43c9-9cf8-b3fd666b4890","Type":"ContainerDied","Data":"b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"}
Jul 17 17:37:41.567572 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:41.567143    2558 scope.go:117] "RemoveContainer" containerID="eacab990b713d9eb5e31064d9af6e3e70ec49dc9d03172cd6126cd7df856ae25"
Jul 17 17:37:41.567572 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:41.567488    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:37:41.567744 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:41.567720    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:42.005166 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:42.005089    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:37:42.574227 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:42.574194    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:37:42.574610 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:42.574383    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:43.409250 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:43.409212    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:37:43.409437 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:43.409377    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:46.640428 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:46.640385    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2"
Jul 17 17:37:46.640829 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:46.640771    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:37:46.640975 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:46.640954    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:37:52.172863 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.172820    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139893856572080"]
Jul 17 17:37:52.173313 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.173229    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" containerName="maas-api"
Jul 17 17:37:52.173313 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.173242    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" containerName="maas-api"
Jul 17 17:37:52.173313 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.173303    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbe7ed0-92c3-4093-a553-c96b6fc98b58" containerName="maas-api"
Jul 17 17:37:52.176311 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.176294    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:52.181393 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.181355    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-24kmc\""
Jul 17 17:37:52.182010 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.181980    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139893856572080"]
Jul 17 17:37:52.262878 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.262835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66dqp\" (UniqueName: \"kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp\") pod \"test-curl-7546-139893856572080\" (UID: \"5b370397-c882-4adc-bf0f-fa806912c2cf\") " pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:52.363893 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.363843    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66dqp\" (UniqueName: \"kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp\") pod \"test-curl-7546-139893856572080\" (UID: \"5b370397-c882-4adc-bf0f-fa806912c2cf\") " pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:52.373577 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.373550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66dqp\" (UniqueName: \"kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp\") pod \"test-curl-7546-139893856572080\" (UID: \"5b370397-c882-4adc-bf0f-fa806912c2cf\") " pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:52.488093 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.487995    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:52.627251 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:52.627223    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139893856572080"]
Jul 17 17:37:52.629512 ip-10-0-134-12 kubenswrapper[2558]: W0717 17:37:52.629486    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b370397_c882_4adc_bf0f_fa806912c2cf.slice/crio-070cffc87a6cf7a24c318dc709450e4c2f5b2cc33b0d1d706263dd2a07c886f8 WatchSource:0}: Error finding container 070cffc87a6cf7a24c318dc709450e4c2f5b2cc33b0d1d706263dd2a07c886f8: Status 404 returned error can't find the container with id 070cffc87a6cf7a24c318dc709450e4c2f5b2cc33b0d1d706263dd2a07c886f8
Jul 17 17:37:53.635981 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:53.635876    2558 generic.go:356] "Generic (PLEG): container finished" podID="5b370397-c882-4adc-bf0f-fa806912c2cf" containerID="6b97a2a5146f981643c3a9b8ac683d46ed8b74273b60f6fb833c0ba08da69a89" exitCode=0
Jul 17 17:37:53.635981 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:53.635957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139893856572080" event={"ID":"5b370397-c882-4adc-bf0f-fa806912c2cf","Type":"ContainerDied","Data":"6b97a2a5146f981643c3a9b8ac683d46ed8b74273b60f6fb833c0ba08da69a89"}
Jul 17 17:37:53.636411 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:53.636001    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139893856572080" event={"ID":"5b370397-c882-4adc-bf0f-fa806912c2cf","Type":"ContainerStarted","Data":"070cffc87a6cf7a24c318dc709450e4c2f5b2cc33b0d1d706263dd2a07c886f8"}
Jul 17 17:37:54.777414 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.777379    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:54.816551 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.816518    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139893856572080_5b370397-c882-4adc-bf0f-fa806912c2cf/test-curl-7546-139893856572080/0.log"
Jul 17 17:37:54.840704 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.840665    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139893856572080"]
Jul 17 17:37:54.844273 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.844243    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139893856572080"]
Jul 17 17:37:54.886062 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.886030    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66dqp\" (UniqueName: \"kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp\") pod \"5b370397-c882-4adc-bf0f-fa806912c2cf\" (UID: \"5b370397-c882-4adc-bf0f-fa806912c2cf\") "
Jul 17 17:37:54.888467 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.888439    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp" (OuterVolumeSpecName: "kube-api-access-66dqp") pod "5b370397-c882-4adc-bf0f-fa806912c2cf" (UID: "5b370397-c882-4adc-bf0f-fa806912c2cf"). InnerVolumeSpecName "kube-api-access-66dqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:37:54.987752 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:54.987717    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66dqp\" (UniqueName: \"kubernetes.io/projected/5b370397-c882-4adc-bf0f-fa806912c2cf-kube-api-access-66dqp\") on node \"ip-10-0-134-12.ec2.internal\" DevicePath \"\""
Jul 17 17:37:55.411778 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:55.411750    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:37:55.412007 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:55.411954    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:37:55.415282 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:55.415251    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b370397-c882-4adc-bf0f-fa806912c2cf" path="/var/lib/kubelet/pods/5b370397-c882-4adc-bf0f-fa806912c2cf/volumes"
Jul 17 17:37:55.647461 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:55.647434    2558 scope.go:117] "RemoveContainer" containerID="6b97a2a5146f981643c3a9b8ac683d46ed8b74273b60f6fb833c0ba08da69a89"
Jul 17 17:37:55.647461 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:55.647448    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139893856572080"
Jul 17 17:37:57.409578 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:37:57.409538    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:37:57.410060 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:37:57.409751    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:38:10.409453 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:10.409413    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:38:10.409868 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:10.409513    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:38:10.409868 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:10.409641    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:38:10.409868 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:10.409676    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:38:24.408658 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:24.408627    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:38:24.409108 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:24.408832    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:38:25.411456 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:25.411423    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:38:25.411909 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:25.411642    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:38:36.408746 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:36.408714    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:38:36.411043 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:36.408884    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:38:38.408881 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:38.408849    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:38:38.409365 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:38.409035    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:38:51.408757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:51.408719    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:38:51.409279 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:51.408908    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:38:52.409463 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:38:52.409429    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:38:52.409885 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:38:52.409599    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:03.407520 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:03.407491    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-schsq_63c706ca-87aa-481b-8086-00d5087d5576/manager/0.log"
Jul 17 17:39:03.528261 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:03.528229    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fsx8h_abd6ad5f-1d55-41c6-b1d9-815d13a6d967/manager/0.log"
Jul 17 17:39:03.654237 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:03.654211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66fdc48964-299g2_2630a6e6-4908-407f-bc34-8eebed0a637f/manager/0.log"
Jul 17 17:39:03.773625 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:03.773588    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qwcng_c0b0458d-a47b-49eb-9cb2-cf82def5c1a5/server/0.log"
Jul 17 17:39:03.902448 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:03.902407    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pnsxd_709d26af-cf5e-4fcf-a9a9-e00e69adb0d2/manager/0.log"
Jul 17 17:39:04.043470 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:04.043392    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-2f9fn_b8cb91c9-c7de-4c70-9508-f81e72b3ddf1/copy-manifests/0.log"
Jul 17 17:39:04.051156 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:04.051114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-2f9fn_b8cb91c9-c7de-4c70-9508-f81e72b3ddf1/manager/0.log"
Jul 17 17:39:04.408583 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:04.408558    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:39:04.408988 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:04.408731    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:39:04.737910 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:04.737828    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-795f6f67d-qjglm_3b7b6a94-2644-427e-b115-224bd19eced1/maas-api/0.log"
Jul 17 17:39:04.993150 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:04.993024    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_627a4826-e534-48b6-8987-656a07f3c51e/maas-api/13.log"
Jul 17 17:39:05.223459 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:05.223420    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_249b1bb3-16f3-43c9-9cf8-b3fd666b4890/maas-api/12.log"
Jul 17 17:39:05.704351 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:05.704315    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-q58l7_cc60842d-8ec6-424a-850f-17558b161c2c/postgres/0.log"
Jul 17 17:39:06.409295 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.409264    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:39:06.409499 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:06.409476    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:06.632369 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.632338    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/util/0.log"
Jul 17 17:39:06.670273 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.670199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/pull/0.log"
Jul 17 17:39:06.693199 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.693168    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/extract/0.log"
Jul 17 17:39:06.838628 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.838599    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/util/0.log"
Jul 17 17:39:06.859868 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.859845    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/pull/0.log"
Jul 17 17:39:06.873700 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:06.873669    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/extract/0.log"
Jul 17 17:39:07.004615 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.004521    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/util/0.log"
Jul 17 17:39:07.013242 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.013196    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/pull/0.log"
Jul 17 17:39:07.023823 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.023789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/extract/0.log"
Jul 17 17:39:07.171646 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.171616    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/util/0.log"
Jul 17 17:39:07.178989 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.178965    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/pull/0.log"
Jul 17 17:39:07.185912 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.185887    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/extract/0.log"
Jul 17 17:39:07.463437 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:07.463405    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pzvhb_f7f07752-854e-4e41-827d-624c25f50d08/manager/0.log"
Jul 17 17:39:08.907706 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:08.907678    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sjzh6_f4b8f90e-2751-441f-b06e-eb81dc50784c/discovery/0.log"
Jul 17 17:39:09.162937 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:09.162912    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8db87d7-rljpt_76707da4-bb9d-473f-92c3-73e73f0a3f14/kube-auth-proxy/0.log"
Jul 17 17:39:09.434110 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:09.434001    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bfk76_6ad944ed-7ef4-4a27-8ba8-c1464edc13c8/payload-pre-processing/0.log"
Jul 17 17:39:09.571983 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:09.571954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2rrvv_0c06e839-75fc-44a0-912a-5910be30e1c9/payload-processing/0.log"
Jul 17 17:39:10.065010 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:10.064979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lbwzj_8ed473ea-e1c7-4dd6-9683-140fecdf791e/main/0.log"
Jul 17 17:39:10.455193 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:10.455159    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbrlm9g_b2185a37-038a-4938-af81-cb77f16a416f/main/0.log"
Jul 17 17:39:18.409562 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:18.409530    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:39:18.409953 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:18.409686    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:39:20.598177 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:20.598140    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-cqmvb_c9d76e05-0fda-4a65-a3de-c656941e5799/global-pull-secret-syncer/0.log"
Jul 17 17:39:20.852880 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:20.852799    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zt999_2ff89ab6-7072-4bbc-a35b-d393540dfc67/konnectivity-agent/0.log"
Jul 17 17:39:20.934605 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:20.934571    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-12.ec2.internal_5784c315c79fb4bd1f99b0628dd3ba86/haproxy/0.log"
Jul 17 17:39:21.415199 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:21.415175    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:39:21.415462 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:21.415449    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:39:22.109365 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:22.109272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerStarted","Data":"949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"}
Jul 17 17:39:22.109749 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:22.109486    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:39:23.116910 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:23.116871    2558 generic.go:356] "Generic (PLEG): container finished" podID="627a4826-e534-48b6-8987-656a07f3c51e" containerID="949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a" exitCode=1
Jul 17 17:39:23.117441 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:23.116941    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" event={"ID":"627a4826-e534-48b6-8987-656a07f3c51e","Type":"ContainerDied","Data":"949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"}
Jul 17 17:39:23.117441 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:23.117030    2558 scope.go:117] "RemoveContainer" containerID="42a88ce03a0f1eb0324ffa47a205ba3a19e02cb2867b7cdfb5e57f693c388dac"
Jul 17 17:39:23.117441 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:23.117298    2558 scope.go:117] "RemoveContainer" containerID="949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"
Jul 17 17:39:23.117580 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:23.117501    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:24.125586 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:24.125557    2558 scope.go:117] "RemoveContainer" containerID="949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"
Jul 17 17:39:24.125984 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:24.125743    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:25.296640 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.296563    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/extract/0.log"
Jul 17 17:39:25.358658 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.358626    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/util/0.log"
Jul 17 17:39:25.432678 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.432652    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759p77gk_eb8d15d0-1f79-44e5-a1ff-ea9287961ed9/pull/0.log"
Jul 17 17:39:25.506501 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.506471    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/extract/0.log"
Jul 17 17:39:25.559569 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.559487    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/util/0.log"
Jul 17 17:39:25.599853 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.599827    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02js55_5c877273-801b-4128-be70-38dc65ded920/pull/0.log"
Jul 17 17:39:25.648386 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.648362    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/extract/0.log"
Jul 17 17:39:25.692967 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.692940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/util/0.log"
Jul 17 17:39:25.734450 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.734413    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qzztb_ef62e96d-8150-4c6e-9da0-9952008a9079/pull/0.log"
Jul 17 17:39:25.794779 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.794752    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/extract/0.log"
Jul 17 17:39:25.842784 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.842696    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/util/0.log"
Jul 17 17:39:25.890653 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:25.890624    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hbzwr_8c431220-e2e4-4e03-9f8f-8eecead8e257/pull/0.log"
Jul 17 17:39:26.375230 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:26.375199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-pzvhb_f7f07752-854e-4e41-827d-624c25f50d08/manager/0.log"
Jul 17 17:39:28.313253 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:28.313221    2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz"
Jul 17 17:39:28.313653 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:28.313629    2558 scope.go:117] "RemoveContainer" containerID="949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"
Jul 17 17:39:28.313809 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:28.313788    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:29.014757 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:29.014729    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-p8h57_cfe023c3-ea33-4624-ad19-faabc231fe38/monitoring-plugin/0.log"
Jul 17 17:39:29.064633 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:29.064606    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jzm4_b2e78b46-7af1-4d36-92ac-933bb4f603ac/node-exporter/0.log"
Jul 17 17:39:29.093175 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:29.093117    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jzm4_b2e78b46-7af1-4d36-92ac-933bb4f603ac/kube-rbac-proxy/0.log"
Jul 17 17:39:29.159378 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:29.159348    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jzm4_b2e78b46-7af1-4d36-92ac-933bb4f603ac/init-textfile/0.log"
Jul 17 17:39:30.126392 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.126352    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"]
Jul 17 17:39:30.126794 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.126768    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b370397-c882-4adc-bf0f-fa806912c2cf" containerName="test-curl-7546-139893856572080"
Jul 17 17:39:30.126794 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.126784    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b370397-c882-4adc-bf0f-fa806912c2cf" containerName="test-curl-7546-139893856572080"
Jul 17 17:39:30.126868 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.126859    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b370397-c882-4adc-bf0f-fa806912c2cf" containerName="test-curl-7546-139893856572080"
Jul 17 17:39:30.131460 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.131436    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.135383 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.135359    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2l68\"/\"openshift-service-ca.crt\""
Jul 17 17:39:30.135528 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.135359    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2l68\"/\"default-dockercfg-nhlfh\""
Jul 17 17:39:30.135946 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.135930    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2l68\"/\"kube-root-ca.crt\""
Jul 17 17:39:30.193727 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.193691    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"]
Jul 17 17:39:30.227008 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.226977    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/thanos-query/0.log"
Jul 17 17:39:30.233067 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.233038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-proc\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.233209 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.233076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-sys\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.233209 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.233097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs4ph\" (UniqueName: \"kubernetes.io/projected/6ae74634-38c6-477d-864e-5488710250c8-kube-api-access-bs4ph\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.233209 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.233178    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-lib-modules\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.233326 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.233255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-podres\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.306608 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.306576    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/kube-rbac-proxy-web/0.log"
Jul 17 17:39:30.334345 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-podres\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334358    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-proc\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334425    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-proc\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334450    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-sys\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs4ph\" (UniqueName: \"kubernetes.io/projected/6ae74634-38c6-477d-864e-5488710250c8-kube-api-access-bs4ph\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-lib-modules\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334547 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-podres\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334859 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-sys\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.334859 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.334607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6ae74634-38c6-477d-864e-5488710250c8-lib-modules\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.351007 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.350969    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs4ph\" (UniqueName: \"kubernetes.io/projected/6ae74634-38c6-477d-864e-5488710250c8-kube-api-access-bs4ph\") pod \"perf-node-gather-daemonset-rgg68\" (UID: \"6ae74634-38c6-477d-864e-5488710250c8\") " pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.378781 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.378702    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/kube-rbac-proxy/0.log"
Jul 17 17:39:30.407331 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.407300    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/prom-label-proxy/0.log"
Jul 17 17:39:30.408831 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.408804    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:39:30.409002 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:30.408983    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:39:30.440890 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.440860    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:30.441053 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.441005    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/kube-rbac-proxy-rules/0.log"
Jul 17 17:39:30.475009 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.474972    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d5dff5b8-tpfsx_458a8ac7-34c5-4f4c-9d88-95660a415b03/kube-rbac-proxy-metrics/0.log"
Jul 17 17:39:30.583945 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:30.583918    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"]
Jul 17 17:39:30.585553 ip-10-0-134-12 kubenswrapper[2558]: W0717 17:39:30.585517    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6ae74634_38c6_477d_864e_5488710250c8.slice/crio-f52cf627a439b5793a6d67446ecf6caf29243e1250271aff98a24ab0bb330eec WatchSource:0}: Error finding container f52cf627a439b5793a6d67446ecf6caf29243e1250271aff98a24ab0bb330eec: Status 404 returned error can't find the container with id f52cf627a439b5793a6d67446ecf6caf29243e1250271aff98a24ab0bb330eec
Jul 17 17:39:31.163682 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:31.163644    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68" event={"ID":"6ae74634-38c6-477d-864e-5488710250c8","Type":"ContainerStarted","Data":"7f353dce6150cab968b90e10bfa4bdb61c97846294d2bf861471b2e578427c8f"}
Jul 17 17:39:31.164105 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:31.163715    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:31.164105 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:31.163740    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68" event={"ID":"6ae74634-38c6-477d-864e-5488710250c8","Type":"ContainerStarted","Data":"f52cf627a439b5793a6d67446ecf6caf29243e1250271aff98a24ab0bb330eec"}
Jul 17 17:39:31.184201 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:31.184143    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68" podStartSLOduration=1.184108742 podStartE2EDuration="1.184108742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:39:31.182842636 +0000 UTC m=+4406.295385211" watchObservedRunningTime="2026-07-17 17:39:31.184108742 +0000 UTC m=+4406.296651317"
Jul 17 17:39:34.584627 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:34.584577    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gv9nc_3ee71457-9c7d-41f1-bb86-3c69f0f160fe/dns/0.log"
Jul 17 17:39:34.624088 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:34.624053    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gv9nc_3ee71457-9c7d-41f1-bb86-3c69f0f160fe/kube-rbac-proxy/0.log"
Jul 17 17:39:34.760368 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:34.760342    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mk9jg_0b2ad5ea-7bf1-4c8e-b170-0e0f3b860ac0/dns-node-resolver/0.log"
Jul 17 17:39:35.468345 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:35.468318    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m7vf9_5223a0b4-ae1e-4100-9573-48ed5f55f20e/node-ca/0.log"
Jul 17 17:39:36.668738 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:36.668706    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sjzh6_f4b8f90e-2751-441f-b06e-eb81dc50784c/discovery/0.log"
Jul 17 17:39:36.745587 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:36.745561    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8db87d7-rljpt_76707da4-bb9d-473f-92c3-73e73f0a3f14/kube-auth-proxy/0.log"
Jul 17 17:39:36.871299 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:36.871268    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bfk76_6ad944ed-7ef4-4a27-8ba8-c1464edc13c8/payload-pre-processing/0.log"
Jul 17 17:39:36.919509 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:36.919425    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2rrvv_0c06e839-75fc-44a0-912a-5910be30e1c9/payload-processing/0.log"
Jul 17 17:39:37.179426 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:37.179335    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2l68/perf-node-gather-daemonset-rgg68"
Jul 17 17:39:37.673442 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:37.673417    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xf2nt_c77d63b4-d290-4121-b00b-1caaf25d0346/serve-healthcheck-canary/0.log"
Jul 17 17:39:38.297570 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:38.297540    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dw6d9_800d8648-76c4-496d-80b6-ede3a10dceaf/kube-rbac-proxy/0.log"
Jul 17 17:39:38.321415 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:38.321379    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dw6d9_800d8648-76c4-496d-80b6-ede3a10dceaf/exporter/0.log"
Jul 17 17:39:38.346735 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:38.346705    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dw6d9_800d8648-76c4-496d-80b6-ede3a10dceaf/extractor/0.log"
Jul 17 17:39:40.931824 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:40.931789    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-schsq_63c706ca-87aa-481b-8086-00d5087d5576/manager/0.log"
Jul 17 17:39:41.117629 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.117598    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-fsx8h_abd6ad5f-1d55-41c6-b1d9-815d13a6d967/manager/0.log"
Jul 17 17:39:41.265613 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.265500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sjzh6_f4b8f90e-2751-441f-b06e-eb81dc50784c/discovery/0.log"
Jul 17 17:39:41.284024 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.283986    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-66fdc48964-299g2_2630a6e6-4908-407f-bc34-8eebed0a637f/manager/0.log"
Jul 17 17:39:41.302480 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.302453    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8db87d7-rljpt_76707da4-bb9d-473f-92c3-73e73f0a3f14/kube-auth-proxy/0.log"
Jul 17 17:39:41.309325 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.309304    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-qwcng_c0b0458d-a47b-49eb-9cb2-cf82def5c1a5/server/0.log"
Jul 17 17:39:41.387565 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.387512    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bfk76_6ad944ed-7ef4-4a27-8ba8-c1464edc13c8/payload-pre-processing/0.log"
Jul 17 17:39:41.394082 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.394045    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-pnsxd_709d26af-cf5e-4fcf-a9a9-e00e69adb0d2/manager/0.log"
Jul 17 17:39:41.410465 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.410409    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2rrvv_0c06e839-75fc-44a0-912a-5910be30e1c9/payload-processing/0.log"
Jul 17 17:39:41.422200 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.422171    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-2f9fn_b8cb91c9-c7de-4c70-9508-f81e72b3ddf1/manager/0.log"
Jul 17 17:39:41.442707 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:41.442680    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc76599b9-2f9fn_b8cb91c9-c7de-4c70-9508-f81e72b3ddf1/copy-manifests/0.log"
Jul 17 17:39:42.409548 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.409514    2558 scope.go:117] "RemoveContainer" containerID="b8917ab566c52d601770ebccd01b886041430a46f9a3e0f41aef13e976374c9b"
Jul 17 17:39:42.409922 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.409595    2558 scope.go:117] "RemoveContainer" containerID="949d035228dd6f61d4e170dc3da9b0cdb50478f66433e050ac2b1352e62e981a"
Jul 17 17:39:42.409922 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:42.409708    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2_odh-ai-gateway-infra(249b1bb3-16f3-43c9-9cf8-b3fd666b4890)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a8e6750e-5c65f9b57-rghv2" podUID="249b1bb3-16f3-43c9-9cf8-b3fd666b4890"
Jul 17 17:39:42.409922 ip-10-0-134-12 kubenswrapper[2558]: E0717 17:39:42.409731    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz_odh-ai-gateway-infra(627a4826-e534-48b6-8987-656a07f3c51e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8c607776-67bc4678d9-tf6wz" podUID="627a4826-e534-48b6-8987-656a07f3c51e"
Jul 17 17:39:42.743463 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.743372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-sjzh6_f4b8f90e-2751-441f-b06e-eb81dc50784c/discovery/0.log"
Jul 17 17:39:42.772724 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.772698    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55b8db87d7-rljpt_76707da4-bb9d-473f-92c3-73e73f0a3f14/kube-auth-proxy/0.log"
Jul 17 17:39:42.852863 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.852837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-bfk76_6ad944ed-7ef4-4a27-8ba8-c1464edc13c8/payload-pre-processing/0.log"
Jul 17 17:39:42.873940 ip-10-0-134-12 kubenswrapper[2558]: I0717 17:39:42.873905    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-2rrvv_0c06e839-75fc-44a0-912a-5910be30e1c9/payload-processing/0.log"