Jul 08 17:31:28.430201 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 08 17:31:28.430212 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 08 17:31:28.430219 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 08 17:31:28.430428 ip-10-0-141-215 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 08 17:31:38.228146 ip-10-0-141-215 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 08 17:31:38.228162 ip-10-0-141-215 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ddb1f62595054dddbb50b682517450da --
Jul 08 17:33:31.025705 ip-10-0-141-215 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 17:33:31.382281 ip-10-0-141-215 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:33:31.382281 ip-10-0-141-215 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 17:33:31.382281 ip-10-0-141-215 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:33:31.382281 ip-10-0-141-215 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 17:33:31.382281 ip-10-0-141-215 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 17:33:31.383107 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.383022    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 17:33:31.387347 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387328    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.387347 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387343    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.387347 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387348    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.387347 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387354    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387364    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387368    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387373    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387376    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387380    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387384    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387388    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387392    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387398    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387403    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387408    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387426    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387432    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387438    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387444    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387448    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387453    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387458    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.387615 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387462    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387466    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387470    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387473    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387478    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387481    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387485    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387489    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387494    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387499    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387503    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387508    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387512    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387516    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387520    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387526    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387530    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387534    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387538    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387543    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.388432 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387548    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387552    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387556    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387560    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387565    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387569    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387574    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387578    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387582    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387585    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387590    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387594    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387598    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387602    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387606    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387610    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387614    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387619    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387626    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387630    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.389292 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387634    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387638    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387644    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387649    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387653    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387658    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387662    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387666    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387671    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387675    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387679    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387683    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387687    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387691    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387696    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387702    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387708    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387713    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387717    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.390127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387722    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387727    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387731    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387735    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387739    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387743    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387747    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387752    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387756    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387760    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387765    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387769    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387774    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387778    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387782    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387786    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387791    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.387796    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388956    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388965    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.390945 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388969    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388974    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388978    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388982    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388987    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.388995    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389001    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389006    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389011    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389015    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389020    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389025    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389029    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389033    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389038    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389042    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389046    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389051    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389055    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.391817 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389059    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389063    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389067    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389072    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389076    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389081    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389085    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389090    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389095    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389099    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389105    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389109    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389114    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389118    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389122    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389126    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389130    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389134    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389139    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389143    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.392313 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389147    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389152    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389156    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389160    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389164    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389171    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389176    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389181    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389188    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389193    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389197    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389202    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389207    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389211    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389215    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389222    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389227    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389232    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389236    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389241    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.392828 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389247    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389251    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389255    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389260    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389264    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389268    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389273    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389277    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389281    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389285    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389289    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389293    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389298    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389302    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389306    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389310    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389313    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389319    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389323    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389327    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.393316 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389332    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389337    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389341    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389347    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389352    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389356    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389360    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389365    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389369    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389374    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389378    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389382    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389386    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389390    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389394    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389399    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389404    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.389409    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390014    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.393821 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390023    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390027    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390031    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390035    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390039    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390044    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390047    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390052    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390056    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390060    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390064    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390068    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390074    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390080    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390085    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390089    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390093    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390097    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390102    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.394373 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390106    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390111    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390115    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390122    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390127    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390132    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390136    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390140    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390144    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390148    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390153    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390157    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390162    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390166    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390170    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390174    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390179    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390183    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390187    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.394847 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390191    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390195    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390199    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390203    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390207    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390211    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390216    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390220    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390224    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390229    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390232    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390238    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390242    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390246    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390250    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390255    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390259    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390263    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390267    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390271    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.395297 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390276    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390280    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390284    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390288    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390297    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390301    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390305    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390309    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390313    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390317    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390322    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390326    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390331    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390335    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390339    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390343    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390348    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390352    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390356    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390360    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.395807 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390364    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390368    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390372    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390379    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390384    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390389    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390394    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390400    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390404    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390408    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390429    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390434    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390439    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390443    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390448    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390452    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390458    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390463    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390467    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.390471    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.396279 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390562    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390573    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390582    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390589    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390596    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390601    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390607    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390614    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390619    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390623    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390629    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390634    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390639    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390644    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390649    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390654    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390658    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390663    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390669    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390674    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390679    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390684    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390690    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390696    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 17:33:31.396775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390701    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390706    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390712    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390717    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390724    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390728    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390734    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390739    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390753    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390758    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390763    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390767    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390772    2575 flags.go:64] FLAG: --enable-server="true"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390777    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390785    2575 flags.go:64] FLAG: --event-burst="100"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390789    2575 flags.go:64] FLAG: --event-qps="50"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390794    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390799    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390804    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390810    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390815    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390820    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390825    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390830    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390835    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 17:33:31.397341 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390840    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390844    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390849    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390854    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390858    2575 flags.go:64] FLAG: --feature-gates=""
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390864    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390869    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390874    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390879    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390884    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390889    2575 flags.go:64] FLAG: --help="false"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390899    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390904    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390909    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390915    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390921    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390926    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390931    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390936    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390940    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390945    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390950    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390954    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390959    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 08 17:33:31.398027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390963    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390968    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390973    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390978    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390982    2575 flags.go:64] FLAG: --lock-file=""
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390987    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390992    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.390997    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391006    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391010    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391015    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391020    2575 flags.go:64] FLAG: --logging-format="text"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391024    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391030    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391034    2575 flags.go:64] FLAG: --manifest-url=""
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391039    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391045    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391050    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391056    2575 flags.go:64] FLAG: --max-pods="110"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391063    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391068    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391072    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391077    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391083    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391087    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 17:33:31.398645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391092    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391104    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391109    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391114    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391119    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391123    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391132    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391138    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391143    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391147    2575 flags.go:64] FLAG: --port="10250"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391152    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391157    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0884c447ddd7f0ce7"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391162    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391167    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391172    2575 flags.go:64] FLAG: --register-node="true"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391176    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391183    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391187    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391191    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391196    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391202    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391206    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391211    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391217    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391223    2575 flags.go:64] FLAG: --runonce="false"
Jul 08 17:33:31.399470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391229    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391236    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391241    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391246    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391250    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391255    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391261    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391266    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391271    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391276    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391280    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391285    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391290    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391295    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391304    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391313    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391317    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391322    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391328    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391333    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391337    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391341    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391346    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391351    2575 flags.go:64] FLAG: --v="2"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391357    2575 flags.go:64] FLAG: --version="false"
Jul 08 17:33:31.400428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391364    2575 flags.go:64] FLAG: --vmodule=""
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391369    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.391375    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391571    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391578    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391583    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391588    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391593    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391599    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391603    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391607    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391612    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391616    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391620    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391625    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391630    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391634    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391638    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391645    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.401046 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391650    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391656    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391663    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391668    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391672    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391676    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391681    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391686    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391690    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391695    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391699    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391703    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391707    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391712    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391716    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391720    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391724    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391728    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391735    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.401528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391739    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391744    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391749    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391754    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391778    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391795    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391799    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391803    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391808    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391812    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391815    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391818    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391821    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391824    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391827    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391830    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391833    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391836    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391839    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391842    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.402040 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391845    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391848    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391850    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391853    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391855    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391858    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391861    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391863    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391866    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391868    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391871    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391876    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391882    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391885    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391888    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391890    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391893    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391898    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391901    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.402545 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391904    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391906    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391909    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391911    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391915    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391918    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391920    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391923    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391925    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391928    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391930    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391933    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391936    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391939    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391941    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391944    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391947    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391950    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391952    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391954    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.403007 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391957    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391960    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391962    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391965    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.391967    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.392597    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.400340    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.400358    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.400378    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.400384    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400480    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400486    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400489    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400492    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.403519 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400495    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400498    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400501    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400504    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400507    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400509    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400512    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400514    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400517    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400520    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400522    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400525    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400527    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400530    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400533    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400536    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400539    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400542    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400545    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400547    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.403866 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400550    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400552    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400555    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400557    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400560    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400563    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400566    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400569    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400572    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400574    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400578    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400583    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400586    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400589    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400592    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400594    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400597    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400600    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400602    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400605    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.404337 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400607    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400610    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400612    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400615    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400617    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400620    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400623    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400626    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400629    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400632    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400634    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400637    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400640    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400642    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400644    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400647    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400650    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400653    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400656    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400659    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.404834 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400661    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400664    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400667    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400669    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400672    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400674    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400677    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400680    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400682    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400685    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400687    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400690    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400693    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400695    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400698    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400701    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400706    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400709    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400712    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400715    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.405320 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400718    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400721    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400724    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400727    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400729    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400732    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400734    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400737    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400740    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400742    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400745    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400748    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400752    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400755    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.405903 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400758    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.400763    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400876    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400880    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400883    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400886    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400889    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400892    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400894    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400897    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400899    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400902    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400904    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400906    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400909    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 17:33:31.406300 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400912    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400914    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400917    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400920    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400922    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400925    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400927    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400929    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400932    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400934    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400937    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400939    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400942    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400945    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400947    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400950    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400952    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400955    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400957    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400960    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 17:33:31.406707 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400962    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400965    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400968    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400971    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400973    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400976    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400978    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400981    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400983    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400986    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400989    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400991    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400994    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.400998    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401001    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401003    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401006    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401009    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401011    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 17:33:31.407178 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401013    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401016    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401020    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401023    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401026    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401029    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401032    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401034    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401037    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401039    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401042    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401045    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401047    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401050    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401053    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401056    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401058    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401061    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401064    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 17:33:31.407666 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401067    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401069    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401071    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401074    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401076    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401079    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401081    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401084    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401086    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401089    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401093    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401096    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401099    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401102    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401104    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401108    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401111    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401113    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401116    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401119    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 17:33:31.408186 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401122    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401125    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401127    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401130    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401133    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401135    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401138    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:31.401140    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.401145    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.401261    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.406067    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.407552    2575 server.go:1019] "Starting client certificate rotation"
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.407665    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 17:33:31.408756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.407715    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 17:33:31.410133 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.410117    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 17:33:31.411925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.411910    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 17:33:31.424132 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.424113    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 08 17:33:31.426223 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.426210    2575 log.go:25] "Validated CRI v1 image API"
Jul 08 17:33:31.428345 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.428332    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 17:33:31.430396 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.430378    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 be792c87-f33b-4107-ab08-8bab7755d3ee:/dev/nvme0n1p4 fd403b2e-d14d-41b0-b255-5980b61685bb:/dev/nvme0n1p3]
Jul 08 17:33:31.430497 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.430395    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 17:33:31.435081 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.434965    2575 manager.go:216] Machine: {Timestamp:2026-07-08 17:33:31.434484358 +0000 UTC m=+0.301014410 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100143 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ecfd26bff388a416873ac4c0f8cd4 SystemUUID:ec2ecfd2-6bff-388a-4168-73ac4c0f8cd4 BootID:ddb1f625-9505-4ddd-bb50-b682517450da Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e0:c9:4b:39:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e0:c9:4b:39:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:91:06:67:7b:f6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 17:33:31.435081 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.435072    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 17:33:31.435200 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.435145    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 17:33:31.437300 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.437286    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 17:33:31.437739 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.437704    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 17:33:31.437918 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.437750    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-215.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 17:33:31.438536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.438527    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 17:33:31.438567 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.438538    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 17:33:31.438567 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.438550    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 17:33:31.439206 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.439193    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 17:33:31.440686 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.440676    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 17:33:31.444786 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444774    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 17:33:31.444910 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444901    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 17:33:31.444949 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444945    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 17:33:31.444979 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444958    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 17:33:31.444979 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444972    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 17:33:31.445032 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444989    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 08 17:33:31.445032 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.444998    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 17:33:31.445489 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.445467    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 17:33:31.445489 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.445489    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 17:33:31.448880 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.448858    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 17:33:31.450963 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.450948    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 17:33:31.451028 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.450979    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 17:33:31.452222 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452210    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452226    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452232    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452240    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452255    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452261    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452268    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452273    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452280    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452285    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 17:33:31.452289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452293    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 17:33:31.452712 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452298    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 17:33:31.452712 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452323    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 17:33:31.452712 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.452329    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 17:33:31.454831 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.454805    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-215.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 17:33:31.454950 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.454931    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 17:33:31.455002 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.454961    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 17:33:31.455614 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.455602    2575 server.go:1268] "Started kubelet"
Jul 08 17:33:31.455706 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.455678    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 17:33:31.455770 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.455689    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 17:33:31.455817 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.455762    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 17:33:31.456380 ip-10-0-141-215 systemd[1]: Started Kubernetes Kubelet.
Jul 08 17:33:31.457610 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.457592    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 17:33:31.457797 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.457776    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 17:33:31.461015 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.460997    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 17:33:31.462718 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.461911    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-215.ec2.internal.18c060ea3458ecb7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-215.ec2.internal,UID:ip-10-0-141-215.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-215.ec2.internal,},FirstTimestamp:2026-07-08 17:33:31.455573175 +0000 UTC m=+0.322103208,LastTimestamp:2026-07-08 17:33:31.455573175 +0000 UTC m=+0.322103208,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-215.ec2.internal,}"
Jul 08 17:33:31.462990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.462976    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctfwf"
Jul 08 17:33:31.464931 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.464904    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 17:33:31.464931 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.464906    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 17:33:31.465356 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.465050    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.465700 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465687    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 17:33:31.465772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465716    2575 factory.go:55] Registering systemd factory
Jul 08 17:33:31.465772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465731    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 08 17:33:31.465772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465698    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 17:33:31.465910 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465780    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 17:33:31.465910 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465904    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 17:33:31.465910 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465912    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 17:33:31.466046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465919    2575 factory.go:153] Registering CRI-O factory
Jul 08 17:33:31.466046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.465949    2575 factory.go:223] Registration of the crio container factory successfully
Jul 08 17:33:31.466046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.466014    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 17:33:31.466046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.466041    2575 factory.go:103] Registering Raw factory
Jul 08 17:33:31.466225 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.466056    2575 manager.go:1196] Started watching for new ooms in manager
Jul 08 17:33:31.466529 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.466515    2575 manager.go:349] Starting recovery of all containers
Jul 08 17:33:31.472970 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.472945    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ctfwf"
Jul 08 17:33:31.473598 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.473573    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 08 17:33:31.474026 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.473997    2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-215.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 08 17:33:31.477374 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.477347    2575 manager.go:354] Recovery completed
Jul 08 17:33:31.479596 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.479578    2575 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 08 17:33:31.482547 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.482541    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.484388 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.484368    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.484469 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.484400    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.484527 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.484411    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.485049 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.485033    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 17:33:31.485049 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.485047    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 17:33:31.485138 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.485063    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 17:33:31.485138 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.485074    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.486491 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.486478    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.486556 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.486502    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.486556 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.486515    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.487069 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.487054    2575 policy_none.go:49] "None policy: Start"
Jul 08 17:33:31.487069 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.487072    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 17:33:31.487165 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.487102    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 17:33:31.489006 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.488995    2575 policy_none.go:47] "Start"
Jul 08 17:33:31.530066 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.529951    2575 manager.go:337] "Starting Device Plugin manager"
Jul 08 17:33:31.530154 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.530078    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 17:33:31.530154 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530088    2575 server.go:87] "Starting device plugin registration server"
Jul 08 17:33:31.530285 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530274    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 17:33:31.530348 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530285    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 17:33:31.530395 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530374    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 17:33:31.530477 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530466    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 17:33:31.530516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.530478    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 17:33:31.530976 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.530957    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 17:33:31.531068 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.531010    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.595046 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.595012    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 17:33:31.597198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.596075    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 17:33:31.597198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.596109    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 17:33:31.597198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.596131    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 17:33:31.597198 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.596165    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 17:33:31.598881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.598862    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:31.630951 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.630936    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.631886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.631870    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.631966 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.631904    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.631966 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.631920    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.631966 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.631953    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.639578 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.639537    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.639578 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.639560    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-215.ec2.internal\": node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.651626 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.651603    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.696431 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.696401    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"]
Jul 08 17:33:31.696510 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.696478    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.697912 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.697898    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.697959 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.697925    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.697959 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.697938    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.700392 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.700379    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.700524 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.700509    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.700584 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.700548    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.701280 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701264    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.701366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701293    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.701366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701304    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.701366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701265    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.701366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701338    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.701366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.701349    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.704076 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.704053    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.704176 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.704093    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 17:33:31.704865 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.704849    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 17:33:31.704961 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.704873    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 17:33:31.704961 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.704882    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeHasSufficientPID"
Jul 08 17:33:31.729245 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.729221    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.733810 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.733795    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-215.ec2.internal\" not found" node="ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.752251 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.752229    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.767716 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.767698    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.767778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.767726    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.767778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.767745    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.852819 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.852791    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:31.868283 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868262    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.868350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868295    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.868350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868336    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.868454 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868356    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.868454 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868380    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3312d77bea947e6b51b42d4a15042bb1-config\") pod \"kube-apiserver-proxy-ip-10-0-141-215.ec2.internal\" (UID: \"3312d77bea947e6b51b42d4a15042bb1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.868454 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:31.868410    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09b2620777e3981ec89cbd732c900e0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal\" (UID: \"09b2620777e3981ec89cbd732c900e0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:31.953403 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:31.953325    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.036847 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.036802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:32.037994 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.037971    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:32.053685 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.053663    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.157818 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.157777    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.265099 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.265012    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.294173 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.294148    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:32.365764 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.365725    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.407711 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.407666    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 17:33:32.408171 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.407831    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 17:33:32.408171 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.407878    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 17:33:32.465819 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.465783    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.476384 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.476344    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:28:32 +0000 UTC" deadline="2028-03-15 16:01:14.081095 +0000 UTC"
Jul 08 17:33:32.476469 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.476384    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14782h27m41.604716382s"
Jul 08 17:33:32.566188 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.566133    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.662651 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:32.662612    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3312d77bea947e6b51b42d4a15042bb1.slice/crio-114eab51517c50776fafe0d255e3ba41f788c00fd0ce68a376c26620a1105b5f WatchSource:0}: Error finding container 114eab51517c50776fafe0d255e3ba41f788c00fd0ce68a376c26620a1105b5f: Status 404 returned error can't find the container with id 114eab51517c50776fafe0d255e3ba41f788c00fd0ce68a376c26620a1105b5f
Jul 08 17:33:32.666399 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.666378    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.670337 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.670322    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:33:32.715578 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.715555    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:32.768161 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.768127    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.872556 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:32.872527    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-215.ec2.internal\" not found"
Jul 08 17:33:32.944737 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.944707    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:32.965427 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.965393    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:32.977502 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.977482    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 17:33:32.978483 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.978469    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal"
Jul 08 17:33:32.987930 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:32.987914    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 17:33:33.447180 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.447136    2575 apiserver.go:52] "Watching apiserver"
Jul 08 17:33:33.456154 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.456123    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 17:33:33.456630 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.456576    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-6swbf","openshift-network-operator/iptables-alerter-rzzlg","openshift-ovn-kubernetes/ovnkube-node-4zpzs","kube-system/global-pull-secret-syncer-t8txt","kube-system/konnectivity-agent-ntn76","kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc","openshift-cluster-node-tuning-operator/tuned-wm9mr","openshift-dns/node-resolver-zjwjh","openshift-image-registry/node-ca-bmj4c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal","openshift-multus/multus-62kbb","openshift-multus/multus-additional-cni-plugins-thq8l","openshift-multus/network-metrics-daemon-c76z4"]
Jul 08 17:33:33.459389 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.459361    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.462251 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.462134    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.462353 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.462268    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jmg7d\""
Jul 08 17:33:33.462353 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.462313    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 17:33:33.462472 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.462424    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.462595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.462575    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.464724 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.464451    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.464979 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.464956    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.465193 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.465173    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 17:33:33.465272 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.465197    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.465272 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.465203    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t5rbp\""
Jul 08 17:33:33.465385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.465204    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 17:33:33.465385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.465287    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 17:33:33.466107 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.466087    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 17:33:33.467036 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.467006    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.467155 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.467129    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:33.467630 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.467611    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 17:33:33.467795 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.467775    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.467919 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.467898    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 17:33:33.468120 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.468102    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.468169 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.468128    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 17:33:33.468169 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.468143    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 17:33:33.468244 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.468165    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-45dxr\""
Jul 08 17:33:33.469556 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.469469    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.471956 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.471937    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.472040 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.472019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:33.472603 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.472581    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zrspr\""
Jul 08 17:33:33.472705 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.472607    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 17:33:33.472705 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.472688    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 17:33:33.474386 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.474366    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.476941 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.476916    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-947gp\""
Jul 08 17:33:33.477044 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.476946    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.477690 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.477631    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:33.477690 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.477670    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.477828 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.477708    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:33.479057 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479038    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479150 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-cnibin\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.479150 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479094    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-systemd-units\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.479276 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-script-lib\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.479276 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479184    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-socket-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-device-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-binary-copy\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.479385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9b89\" (UniqueName: \"kubernetes.io/projected/b829f001-c40d-4f7b-9e34-6edf82de7996-kube-api-access-d9b89\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.479564 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479404    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479619 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnjjc\" (UniqueName: \"kubernetes.io/projected/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kube-api-access-hnjjc\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479675 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479607    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-system-cni-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.479675 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479642    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-systemd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.479772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479699    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-config\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.479772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.479868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-sys-fs\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.479868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.479868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-slash\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479973    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-ovn\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.479997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-netd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480022    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-env-overrides\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ncr9\" (UniqueName: \"kubernetes.io/projected/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-kube-api-access-9ncr9\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-registration-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480096    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-os-release\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480146    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-bin\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480175    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480204    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480245    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-netns\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480285    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-node-log\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-log-socket\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-dbus\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480363    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-kubelet\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480375    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-var-lib-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480415    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-etc-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovn-node-metrics-cert\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.480800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.480480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-kubelet-config\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.482891 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.482868    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.482998 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.482914    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.484275 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.484224    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.486462 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.484492    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 17:33:33.486462 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.484595    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-524kd\""
Jul 08 17:33:33.486462 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.484629    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 17:33:33.486462 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.486117    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 17:33:33.486688 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.486445    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.487224 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.487166    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.487414 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.487390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.487547 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.487406    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c8q8f\""
Jul 08 17:33:33.489937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.489846    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6c8zq\""
Jul 08 17:33:33.489937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.489881    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 17:33:33.489937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.489889    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 17:33:33.489937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.489900    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.492139 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.492121    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wf6zh\""
Jul 08 17:33:33.492383 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.492364    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 17:33:33.509578 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.509551    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-swbgv"
Jul 08 17:33:33.521068 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.521050    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-swbgv"
Jul 08 17:33:33.561602 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.561581    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:33.567433 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.567393    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 17:33:33.580922 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.580902    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-netns\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.581037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.580929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-bin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.581037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.580948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862d283b-1715-4911-936d-276142ca880a-agent-certs\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.581037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.580969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.581037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.580995    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-netd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581047    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-netd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-conf-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-multus-daemon-config\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e6366-2e23-47bd-90bb-af0d14c74f3c-tmp-dir\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-kubernetes\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581206    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-var-lib-kubelet\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.581281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-os-release\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-netns\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-node-log\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-log-socket\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581363    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-os-release\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-dbus\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581420    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581443    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-node-log\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581467    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3b82ba-6368-419e-b1a2-abab0754ec69-host-slash\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-netns\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/376e6366-2e23-47bd-90bb-af0d14c74f3c-hosts-file\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581537    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-kubelet\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581550    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-log-socket\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581562    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-var-lib-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.581588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-hostroot\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-etc-kubernetes\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-conf\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581691    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-var-lib-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581717    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581733    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-kubelet\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-script-lib\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581658    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581770    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-dbus\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581790    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-socket-dir-parent\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581829    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-serviceca\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581866    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysconfig\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-device-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-cnibin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.582352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581938    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-device-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.581962    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582021    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnjjc\" (UniqueName: \"kubernetes.io/projected/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kube-api-access-hnjjc\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-system-cni-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-etc-selinux\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862d283b-1715-4911-936d-276142ca880a-konnectivity-ca\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582122    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j7lf\" (UniqueName: \"kubernetes.io/projected/376e6366-2e23-47bd-90bb-af0d14c74f3c-kube-api-access-2j7lf\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582131    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-system-cni-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582145    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-host\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582177    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-tmp\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582217    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-slash\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-slash\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582353    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582354    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-script-lib\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lmdg\" (UniqueName: \"kubernetes.io/projected/d67ed1cd-606c-4f5c-bd57-b475a7974032-kube-api-access-8lmdg\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.583181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582450    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-run-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-os-release\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpdt6\" (UniqueName: \"kubernetes.io/projected/823def65-7540-403c-a855-1d027ce1a1de-kube-api-access-rpdt6\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2g47\" (UniqueName: \"kubernetes.io/projected/1613e116-de10-434e-853b-3b5617c51570-kube-api-access-f2g47\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582610    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-multus\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582640    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-ovn\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582663    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-env-overrides\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ncr9\" (UniqueName: \"kubernetes.io/projected/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-kube-api-access-9ncr9\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582711    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-cni-binary-copy\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-ovn\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-multus-certs\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582893    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-registration-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-bin\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582931    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-system-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582979    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-registration-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.582983    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:33.583925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583010    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-lib-modules\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-systemd\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-etc-tuned\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583057    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-cni-bin\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583073    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-etc-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-env-overrides\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovn-node-metrics-cert\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583115    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-etc-openvswitch\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583129    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-kubelet-config\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583028    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-k8s-cni-cncf-io\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-kubelet\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583210    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/51ec67ed-7a09-4949-bc7a-0e8ea5639460-kubelet-config\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583353    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-cnibin\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583382    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-systemd-units\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583411    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4b9\" (UniqueName: \"kubernetes.io/projected/2e3b82ba-6368-419e-b1a2-abab0754ec69-kube-api-access-hk4b9\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.585063 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583464    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-host\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583476    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-cnibin\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583489    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-systemd-units\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-run\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-socket-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-binary-copy\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583573    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9b89\" (UniqueName: \"kubernetes.io/projected/b829f001-c40d-4f7b-9e34-6edf82de7996-kube-api-access-d9b89\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk7wk\" (UniqueName: \"kubernetes.io/projected/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-kube-api-access-hk7wk\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583657    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-socket-dir\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583670    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-modprobe-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-sys\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583722    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-systemd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-config\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e3b82ba-6368-419e-b1a2-abab0754ec69-iptables-alerter-script\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-sys-fs\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.585990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.583897    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-run-systemd\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.584002    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/474f4a6d-9857-4b22-9f41-fcc22a598d6d-sys-fs\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.584080    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.584146    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b829f001-c40d-4f7b-9e34-6edf82de7996-tuning-conf-dir\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.584163    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:34.084142841 +0000 UTC m=+2.950672872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.584484    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovnkube-config\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.586895 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.584898    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b829f001-c40d-4f7b-9e34-6edf82de7996-cni-binary-copy\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.587875 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.587851    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-ovn-node-metrics-cert\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.592388 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.592357    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnjjc\" (UniqueName: \"kubernetes.io/projected/474f4a6d-9857-4b22-9f41-fcc22a598d6d-kube-api-access-hnjjc\") pod \"aws-ebs-csi-driver-node-lgkpc\" (UID: \"474f4a6d-9857-4b22-9f41-fcc22a598d6d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.592470 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.592431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ncr9\" (UniqueName: \"kubernetes.io/projected/e76792ab-dfda-4b1a-aa06-2ddadacd7cee-kube-api-access-9ncr9\") pod \"ovnkube-node-4zpzs\" (UID: \"e76792ab-dfda-4b1a-aa06-2ddadacd7cee\") " pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.595478 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.595441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9b89\" (UniqueName: \"kubernetes.io/projected/b829f001-c40d-4f7b-9e34-6edf82de7996-kube-api-access-d9b89\") pod \"multus-additional-cni-plugins-thq8l\" (UID: \"b829f001-c40d-4f7b-9e34-6edf82de7996\") " pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.603795 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.602484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"3312d77bea947e6b51b42d4a15042bb1","Type":"ContainerStarted","Data":"114eab51517c50776fafe0d255e3ba41f788c00fd0ce68a376c26620a1105b5f"}
Jul 08 17:33:33.603968 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.603943    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerStarted","Data":"46aff0b23122df8888fd558ba054419e01682d71eabd6011b8023f73253f73d7"}
Jul 08 17:33:33.684833 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684794    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862d283b-1715-4911-936d-276142ca880a-konnectivity-ca\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684842    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j7lf\" (UniqueName: \"kubernetes.io/projected/376e6366-2e23-47bd-90bb-af0d14c74f3c-kube-api-access-2j7lf\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684868    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-host\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-tmp\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684949    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-host\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684969    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lmdg\" (UniqueName: \"kubernetes.io/projected/d67ed1cd-606c-4f5c-bd57-b475a7974032-kube-api-access-8lmdg\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.685008 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.684996    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-os-release\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685298 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685024    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpdt6\" (UniqueName: \"kubernetes.io/projected/823def65-7540-403c-a855-1d027ce1a1de-kube-api-access-rpdt6\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685298 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685049    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2g47\" (UniqueName: \"kubernetes.io/projected/1613e116-de10-434e-853b-3b5617c51570-kube-api-access-f2g47\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685298 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685179    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-os-release\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685298 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685204    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-multus\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685298 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685259    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-multus\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685364    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-cni-binary-copy\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-multus-certs\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685452    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-system-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685478    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-lib-modules\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-systemd\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-etc-tuned\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/862d283b-1715-4911-936d-276142ca880a-konnectivity-ca\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.685589 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685591    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-k8s-cni-cncf-io\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685600    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-multus-certs\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-system-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685617    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-kubelet\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685668    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-kubelet\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685668    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-systemd\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4b9\" (UniqueName: \"kubernetes.io/projected/2e3b82ba-6368-419e-b1a2-abab0754ec69-kube-api-access-hk4b9\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-host\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-run\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685771    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk7wk\" (UniqueName: \"kubernetes.io/projected/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-kube-api-access-hk7wk\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-modprobe-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-sys\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685830    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685827    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-lib-modules\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685873    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e3b82ba-6368-419e-b1a2-abab0754ec69-iptables-alerter-script\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685903    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-run\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685948    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-netns\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686031 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685953    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-sys\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685953    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-cni-binary-copy\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-host\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685949    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-modprobe-d\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.685904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-netns\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-bin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862d283b-1715-4911-936d-276142ca880a-agent-certs\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686080    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-conf-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686124    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-conf-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686123    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-var-lib-cni-bin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686145    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-multus-daemon-config\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686175    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e6366-2e23-47bd-90bb-af0d14c74f3c-tmp-dir\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686182    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-host-run-k8s-cni-cncf-io\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686198    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-kubernetes\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686247    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-var-lib-kubelet\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3b82ba-6368-419e-b1a2-abab0754ec69-host-slash\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686341    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/376e6366-2e23-47bd-90bb-af0d14c74f3c-hosts-file\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.686953 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686359    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-var-lib-kubelet\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686415    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-hostroot\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686462    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-etc-kubernetes\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-conf\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686484    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2e3b82ba-6368-419e-b1a2-abab0754ec69-iptables-alerter-script\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.686514    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686428    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-cni-dir\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-socket-dir-parent\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/376e6366-2e23-47bd-90bb-af0d14c74f3c-tmp-dir\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-serviceca\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686578    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-multus-socket-dir-parent\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.686586    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:34.186566081 +0000 UTC m=+3.053096106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysconfig\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686646    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-cnibin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686648    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-kubernetes\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/823def65-7540-403c-a855-1d027ce1a1de-multus-daemon-config\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686620    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-etc-kubernetes\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.687872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysctl-conf\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686731    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1613e116-de10-434e-853b-3b5617c51570-etc-sysconfig\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686773    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-hostroot\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686788    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/823def65-7540-403c-a855-1d027ce1a1de-cnibin\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686833    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3b82ba-6368-419e-b1a2-abab0754ec69-host-slash\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/376e6366-2e23-47bd-90bb-af0d14c74f3c-hosts-file\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.686951    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-serviceca\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.688536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.688073    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-tmp\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.688864 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.688778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1613e116-de10-434e-853b-3b5617c51570-etc-tuned\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.689103 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.689081    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/862d283b-1715-4911-936d-276142ca880a-agent-certs\") pod \"konnectivity-agent-ntn76\" (UID: \"862d283b-1715-4911-936d-276142ca880a\") " pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.700359 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.700261    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:33.700359 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.700325    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:33.700359 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.700341    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:33.700609 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:33.700453    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:33:34.200398856 +0000 UTC m=+3.066928900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:33.703027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.702989    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4b9\" (UniqueName: \"kubernetes.io/projected/2e3b82ba-6368-419e-b1a2-abab0754ec69-kube-api-access-hk4b9\") pod \"iptables-alerter-rzzlg\" (UID: \"2e3b82ba-6368-419e-b1a2-abab0754ec69\") " pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.703216 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.703194    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lmdg\" (UniqueName: \"kubernetes.io/projected/d67ed1cd-606c-4f5c-bd57-b475a7974032-kube-api-access-8lmdg\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:33.703645 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.703620    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2g47\" (UniqueName: \"kubernetes.io/projected/1613e116-de10-434e-853b-3b5617c51570-kube-api-access-f2g47\") pod \"tuned-wm9mr\" (UID: \"1613e116-de10-434e-853b-3b5617c51570\") " pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.704418 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.704400    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk7wk\" (UniqueName: \"kubernetes.io/projected/0a77fb5b-7fff-402b-b1a4-74d4e62e2729-kube-api-access-hk7wk\") pod \"node-ca-bmj4c\" (UID: \"0a77fb5b-7fff-402b-b1a4-74d4e62e2729\") " pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.704712 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.704691    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j7lf\" (UniqueName: \"kubernetes.io/projected/376e6366-2e23-47bd-90bb-af0d14c74f3c-kube-api-access-2j7lf\") pod \"node-resolver-zjwjh\" (UID: \"376e6366-2e23-47bd-90bb-af0d14c74f3c\") " pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.704981 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.704961    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpdt6\" (UniqueName: \"kubernetes.io/projected/823def65-7540-403c-a855-1d027ce1a1de-kube-api-access-rpdt6\") pod \"multus-62kbb\" (UID: \"823def65-7540-403c-a855-1d027ce1a1de\") " pod="openshift-multus/multus-62kbb"
Jul 08 17:33:33.773673 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.773637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc"
Jul 08 17:33:33.782674 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.782588    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-thq8l"
Jul 08 17:33:33.785770 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:33.785595    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474f4a6d_9857_4b22_9f41_fcc22a598d6d.slice/crio-749f2790c70167e1555859e6a24ab0b06fb2ce2c8c0f2c22d70150033c7e4842 WatchSource:0}: Error finding container 749f2790c70167e1555859e6a24ab0b06fb2ce2c8c0f2c22d70150033c7e4842: Status 404 returned error can't find the container with id 749f2790c70167e1555859e6a24ab0b06fb2ce2c8c0f2c22d70150033c7e4842
Jul 08 17:33:33.792150 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:33.792130    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb829f001_c40d_4f7b_9e34_6edf82de7996.slice/crio-57c798008de6d45032dc86a08aacae8fae631304d45d19d96866aba5b0cf3351 WatchSource:0}: Error finding container 57c798008de6d45032dc86a08aacae8fae631304d45d19d96866aba5b0cf3351: Status 404 returned error can't find the container with id 57c798008de6d45032dc86a08aacae8fae631304d45d19d96866aba5b0cf3351
Jul 08 17:33:33.793413 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.793359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:33.798458 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.798437    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:33.804575 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.804556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zjwjh"
Jul 08 17:33:33.815592 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.815570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rzzlg"
Jul 08 17:33:33.821090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.821072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bmj4c"
Jul 08 17:33:33.827010 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.826989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wm9mr"
Jul 08 17:33:33.831936 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:33.831919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-62kbb"
Jul 08 17:33:34.089990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.089914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:34.090153 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.090094    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:34.090204 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.090166    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:35.090149918 +0000 UTC m=+3.956679963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:34.148974 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.148941    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode76792ab_dfda_4b1a_aa06_2ddadacd7cee.slice/crio-7d7f603ba9ae9079e536a6ece221e03055bfe2f34aa8613d764076461a32ae7d WatchSource:0}: Error finding container 7d7f603ba9ae9079e536a6ece221e03055bfe2f34aa8613d764076461a32ae7d: Status 404 returned error can't find the container with id 7d7f603ba9ae9079e536a6ece221e03055bfe2f34aa8613d764076461a32ae7d
Jul 08 17:33:34.190530 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.190493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:34.190711 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.190690    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:34.190802 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.190773    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:35.190750714 +0000 UTC m=+4.057280744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:34.275819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.275781    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 17:33:34.291775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.291725    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:34.291953 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.291885    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:34.291953 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.291908    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:34.291953 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.291922    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:34.292152 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:34.291978    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:33:35.291959772 +0000 UTC m=+4.158489795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:34.524537 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.524443    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:28:34 +0000 UTC" deadline="2028-02-11 01:50:07.801843507 +0000 UTC"
Jul 08 17:33:34.524537 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.524483    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13976h16m33.277365536s"
Jul 08 17:33:34.606489 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.606397    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1613e116_de10_434e_853b_3b5617c51570.slice/crio-00bb5f965535b70edac081f3a3f70d6aa4527ed2504c5d97dd6ac7d135329584 WatchSource:0}: Error finding container 00bb5f965535b70edac081f3a3f70d6aa4527ed2504c5d97dd6ac7d135329584: Status 404 returned error can't find the container with id 00bb5f965535b70edac081f3a3f70d6aa4527ed2504c5d97dd6ac7d135329584
Jul 08 17:33:34.608464 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.608414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"7d7f603ba9ae9079e536a6ece221e03055bfe2f34aa8613d764076461a32ae7d"}
Jul 08 17:33:34.612597 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.610369    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a77fb5b_7fff_402b_b1a4_74d4e62e2729.slice/crio-30d4528ed19dd17afc0fe4b97ad8eda2ccfd590c62ad017204976e2dac52cb83 WatchSource:0}: Error finding container 30d4528ed19dd17afc0fe4b97ad8eda2ccfd590c62ad017204976e2dac52cb83: Status 404 returned error can't find the container with id 30d4528ed19dd17afc0fe4b97ad8eda2ccfd590c62ad017204976e2dac52cb83
Jul 08 17:33:34.612597 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.612286    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerStarted","Data":"57c798008de6d45032dc86a08aacae8fae631304d45d19d96866aba5b0cf3351"}
Jul 08 17:33:34.614620 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.614554    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862d283b_1715_4911_936d_276142ca880a.slice/crio-5d937db771cbe361899a2c138ed1f3869808986f2fd0e7c0af2ddfdb95ee67e1 WatchSource:0}: Error finding container 5d937db771cbe361899a2c138ed1f3869808986f2fd0e7c0af2ddfdb95ee67e1: Status 404 returned error can't find the container with id 5d937db771cbe361899a2c138ed1f3869808986f2fd0e7c0af2ddfdb95ee67e1
Jul 08 17:33:34.617054 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:34.616337    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc" event={"ID":"474f4a6d-9857-4b22-9f41-fcc22a598d6d","Type":"ContainerStarted","Data":"749f2790c70167e1555859e6a24ab0b06fb2ce2c8c0f2c22d70150033c7e4842"}
Jul 08 17:33:34.617940 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.617898    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376e6366_2e23_47bd_90bb_af0d14c74f3c.slice/crio-8e6d42246284de12d0bbce768d907979c860756f0f51671dbeff8a4d7978f340 WatchSource:0}: Error finding container 8e6d42246284de12d0bbce768d907979c860756f0f51671dbeff8a4d7978f340: Status 404 returned error can't find the container with id 8e6d42246284de12d0bbce768d907979c860756f0f51671dbeff8a4d7978f340
Jul 08 17:33:34.618513 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.618352    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3b82ba_6368_419e_b1a2_abab0754ec69.slice/crio-ec8b87a6f3bf1ba95fe4e3093645838d6c25a87f733b44f6f746a147c5a427ac WatchSource:0}: Error finding container ec8b87a6f3bf1ba95fe4e3093645838d6c25a87f733b44f6f746a147c5a427ac: Status 404 returned error can't find the container with id ec8b87a6f3bf1ba95fe4e3093645838d6c25a87f733b44f6f746a147c5a427ac
Jul 08 17:33:34.622554 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:33:34.622503    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod823def65_7540_403c_a855_1d027ce1a1de.slice/crio-e416cf5299a0888413c34cc5f070977a7b415109c5ebfa5b39d4c49f8607dacb WatchSource:0}: Error finding container e416cf5299a0888413c34cc5f070977a7b415109c5ebfa5b39d4c49f8607dacb: Status 404 returned error can't find the container with id e416cf5299a0888413c34cc5f070977a7b415109c5ebfa5b39d4c49f8607dacb
Jul 08 17:33:35.100188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.100137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:35.100367 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.100344    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:35.100443 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.100422    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:37.100401854 +0000 UTC m=+5.966931878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:35.201697 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.200994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:35.201697 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.201187    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:35.201697 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.201255    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:37.201233777 +0000 UTC m=+6.067763802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:35.302401 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.301752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:35.302401 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.301929    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:35.302401 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.301949    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:35.302401 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.301962    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:35.302401 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.302023    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:33:37.302004239 +0000 UTC m=+6.168534265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:35.525517 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.525176    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:28:34 +0000 UTC" deadline="2028-01-13 20:17:40.641041378 +0000 UTC"
Jul 08 17:33:35.525517 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.525490    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13298h44m5.115557883s"
Jul 08 17:33:35.599245 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.599213    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:35.599437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.599365    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:35.599829 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.599808    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:35.599932 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.599911    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:35.600006 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.599983    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:35.600076 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:35.600057    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:35.647295 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.646655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" event={"ID":"3312d77bea947e6b51b42d4a15042bb1","Type":"ContainerStarted","Data":"b9d375bcab5af2352d19bfc5db6741b8a6cb91bff670d3aae4da680eab5713d6"}
Jul 08 17:33:35.657656 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.657580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjwjh" event={"ID":"376e6366-2e23-47bd-90bb-af0d14c74f3c","Type":"ContainerStarted","Data":"8e6d42246284de12d0bbce768d907979c860756f0f51671dbeff8a4d7978f340"}
Jul 08 17:33:35.665804 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.665723    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmj4c" event={"ID":"0a77fb5b-7fff-402b-b1a4-74d4e62e2729","Type":"ContainerStarted","Data":"30d4528ed19dd17afc0fe4b97ad8eda2ccfd590c62ad017204976e2dac52cb83"}
Jul 08 17:33:35.678325 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.678261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wm9mr" event={"ID":"1613e116-de10-434e-853b-3b5617c51570","Type":"ContainerStarted","Data":"00bb5f965535b70edac081f3a3f70d6aa4527ed2504c5d97dd6ac7d135329584"}
Jul 08 17:33:35.711567 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.711527    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-62kbb" event={"ID":"823def65-7540-403c-a855-1d027ce1a1de","Type":"ContainerStarted","Data":"e416cf5299a0888413c34cc5f070977a7b415109c5ebfa5b39d4c49f8607dacb"}
Jul 08 17:33:35.724984 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.724949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzzlg" event={"ID":"2e3b82ba-6368-419e-b1a2-abab0754ec69","Type":"ContainerStarted","Data":"ec8b87a6f3bf1ba95fe4e3093645838d6c25a87f733b44f6f746a147c5a427ac"}
Jul 08 17:33:35.728262 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:35.728230    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntn76" event={"ID":"862d283b-1715-4911-936d-276142ca880a","Type":"ContainerStarted","Data":"5d937db771cbe361899a2c138ed1f3869808986f2fd0e7c0af2ddfdb95ee67e1"}
Jul 08 17:33:37.117516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.117468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:37.118002 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.117703    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:37.118002 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.117776    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:41.117755453 +0000 UTC m=+9.984285476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:37.218847 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.218209    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:37.218847 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.218392    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:37.218847 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.218486    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:41.21844978 +0000 UTC m=+10.084979810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:37.319509 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.319468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:37.319715 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.319657    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:37.319715 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.319679    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:37.319715 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.319695    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:37.319899 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.319774    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:33:41.319752637 +0000 UTC m=+10.186282662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:37.597447 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.597246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:37.597447 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.597268    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:37.597447 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.597399    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:37.597768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:37.597471    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:37.597768 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.597568    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:37.597768 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:37.597639    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:39.596905 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:39.596857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:39.596905 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:39.596857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:39.597491 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:39.596998    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:39.597491 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:39.597054    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:39.597491 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:39.597150    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:39.597491 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:39.597224    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:41.152660 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.152620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:41.153153 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.152762    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:41.153153 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.152827    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:49.152808563 +0000 UTC m=+18.019338587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:41.253727 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.253688    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:41.253904 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.253890    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:41.253962 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.253953    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:49.253932924 +0000 UTC m=+18.120462946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:41.354865 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.354824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:41.355051 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.355012    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:41.355051 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.355041    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:41.355159 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.355058    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:41.355159 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.355132    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:33:49.355112811 +0000 UTC m=+18.221642836 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:41.597881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.597733    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:41.597881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.597778    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:41.597881 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.597852    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:41.598140 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.597921    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:41.598140 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:41.597988    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:41.598140 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:41.598077    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:43.597524 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:43.597043    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:43.597524 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:43.597166    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:43.598309 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:43.597630    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:43.598309 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:43.597824    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:43.598309 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:43.597861    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:43.598309 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:43.597926    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:45.596753 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:45.596718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:45.597202 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:45.596718    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:45.597202 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:45.596863    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:45.597202 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:45.596719    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:45.597202 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:45.596886    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:45.597202 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:45.597003    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:47.597114 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:47.597072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:47.597557 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:47.597119    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:47.597557 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:47.597072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:47.597557 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:47.597215    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:47.597557 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:47.597289    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:47.597557 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:47.597373    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:49.216694 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.216662    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:49.217076 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.216782    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:49.217076 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.216833    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:05.216820008 +0000 UTC m=+34.083350029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:33:49.317631 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.317594    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:49.317747 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.317702    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:49.317801 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.317758    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:05.31774338 +0000 UTC m=+34.184273402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:33:49.418265 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.418231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:49.418440 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.418403    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:33:49.418492 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.418446    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:33:49.418492 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.418459    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:49.418572 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.418508    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:34:05.418493855 +0000 UTC m=+34.285023875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:33:49.597178 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.597089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:49.597334 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.597088    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:49.597334 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.597229    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:49.597334 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:49.597095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:49.597334 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.597306    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:49.597551 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:49.597368    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:51.600019 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:51.599986    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:51.600518 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:51.600145    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:51.600518 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:51.600243    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:51.600518 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:51.600477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:51.600749 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:51.600685    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:51.601078 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:51.601049    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:53.598124 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.598102    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:53.598694 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:53.598663    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:53.599007 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.598985    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:53.599132 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:53.599093    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:53.599280 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.599142    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:53.599342 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:53.599315    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:53.767990 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.767802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"87d6c476a15f3e83279d168642846ced0a6ed5d12aabfaaf6f174ddca69ad0b3"}
Jul 08 17:33:53.769320 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.769292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-62kbb" event={"ID":"823def65-7540-403c-a855-1d027ce1a1de","Type":"ContainerStarted","Data":"142a15ee692c714fe7b3931af1e7eb166b66aabe303fb1b503a38cdefa840c1d"}
Jul 08 17:33:53.770780 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.770757    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wm9mr" event={"ID":"1613e116-de10-434e-853b-3b5617c51570","Type":"ContainerStarted","Data":"873a1b34e8b0b290be35e4228c0358570ade24f535c2ef66699242f950a2234b"}
Jul 08 17:33:53.799280 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.799206    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-215.ec2.internal" podStartSLOduration=20.799172081000002 podStartE2EDuration="20.799172081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:35.66529456 +0000 UTC m=+4.531824621" watchObservedRunningTime="2026-07-08 17:33:53.799172081 +0000 UTC m=+22.665702154"
Jul 08 17:33:53.799803 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.799745    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-62kbb" podStartSLOduration=2.941507895 podStartE2EDuration="21.799727684s" totalImagesPullingTime="18.858219789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:53.799143967 +0000 UTC m=+22.665674011" watchObservedRunningTime="2026-07-08 17:33:53.799727684 +0000 UTC m=+22.666257728"
Jul 08 17:33:53.821479 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:53.821429    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wm9mr" podStartSLOduration=2.954266237 podStartE2EDuration="21.821401118s" totalImagesPullingTime="18.867134881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:53.820838201 +0000 UTC m=+22.687368271" watchObservedRunningTime="2026-07-08 17:33:53.821401118 +0000 UTC m=+22.687931158"
Jul 08 17:33:54.775334 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775163    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775625    2575 generic.go:356] "Generic (PLEG): container finished" podID="e76792ab-dfda-4b1a-aa06-2ddadacd7cee" containerID="09bd3d563fff9454e6166d9706f30dca617d3610007cc0ce8c9bd36f8274e81d" exitCode=1
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775701    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"b5bb9faf57e68b381964b5a90511569752276451363c515902f048ef377fa1f2"}
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775862    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"459daa501616731c425b65a6102f18726fa210e5d0c2b2d2580a143644501c13"}
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775918    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"1bc85dfff12715c320375705f9a42450c7ecb9cb7353d804f342aae57019cc26"}
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775949    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"a1ae126b3bf8532340324a24aac52d1a0a25199d375ebb4f212502ee18375d1e"}
Jul 08 17:33:54.776005 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.775976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerDied","Data":"09bd3d563fff9454e6166d9706f30dca617d3610007cc0ce8c9bd36f8274e81d"}
Jul 08 17:33:54.777067 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.777046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rzzlg" event={"ID":"2e3b82ba-6368-419e-b1a2-abab0754ec69","Type":"ContainerStarted","Data":"e03a74d3dd5251e078df5fc4f58764313be5de8bee3dd1c74382d4a04ebaa1ed"}
Jul 08 17:33:54.778390 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.778366    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ntn76" event={"ID":"862d283b-1715-4911-936d-276142ca880a","Type":"ContainerStarted","Data":"f153c53ebacaa862ac992961bda02dc2a26479a9297c32f54820ef09f6c45f90"}
Jul 08 17:33:54.779754 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.779733    2575 generic.go:356] "Generic (PLEG): container finished" podID="09b2620777e3981ec89cbd732c900e0c" containerID="3c81618fe7c2dfd68747f9b3ca340517ad5d9995a9e89b495ea67f9e98888cba" exitCode=0
Jul 08 17:33:54.779866 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.779808    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerDied","Data":"3c81618fe7c2dfd68747f9b3ca340517ad5d9995a9e89b495ea67f9e98888cba"}
Jul 08 17:33:54.781152 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.781129    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="5b5cd2fb5bf1a080f03b8b36c990421ecf988e55a46ff02d60d33999a1fea135" exitCode=0
Jul 08 17:33:54.781245 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.781208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"5b5cd2fb5bf1a080f03b8b36c990421ecf988e55a46ff02d60d33999a1fea135"}
Jul 08 17:33:54.782505 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.782488    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc" event={"ID":"474f4a6d-9857-4b22-9f41-fcc22a598d6d","Type":"ContainerStarted","Data":"533477da957e4e464dc8a2f1b4a2934752ee3368bf8edb665eda525667113e73"}
Jul 08 17:33:54.783815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.783793    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zjwjh" event={"ID":"376e6366-2e23-47bd-90bb-af0d14c74f3c","Type":"ContainerStarted","Data":"1c63635ddeef714358046573d01bdab9878ec847661a23b634202ccbe795e646"}
Jul 08 17:33:54.785014 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.784995    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bmj4c" event={"ID":"0a77fb5b-7fff-402b-b1a4-74d4e62e2729","Type":"ContainerStarted","Data":"a310b4b530eef9b5cdede8e8c938730a93e12857f35307214e307d7519330fb3"}
Jul 08 17:33:54.794184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.794148    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rzzlg" podStartSLOduration=3.942316924 podStartE2EDuration="22.794136662s" totalImagesPullingTime="18.851819738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:54.793912705 +0000 UTC m=+23.660442746" watchObservedRunningTime="2026-07-08 17:33:54.794136662 +0000 UTC m=+23.660666704"
Jul 08 17:33:54.827185 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.827141    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zjwjh" podStartSLOduration=3.974135174 podStartE2EDuration="22.827125837s" totalImagesPullingTime="18.852990663s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:54.812007801 +0000 UTC m=+23.678537854" watchObservedRunningTime="2026-07-08 17:33:54.827125837 +0000 UTC m=+23.693655899"
Jul 08 17:33:54.844700 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.844650    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ntn76" podStartSLOduration=4.004657212 podStartE2EDuration="22.844634666s" totalImagesPullingTime="18.839977454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:54.82704115 +0000 UTC m=+23.693571174" watchObservedRunningTime="2026-07-08 17:33:54.844634666 +0000 UTC m=+23.711164708"
Jul 08 17:33:54.844892 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:54.844873    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bmj4c" podStartSLOduration=3.987559466 podStartE2EDuration="22.844867076s" totalImagesPullingTime="18.85730761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:54.844269479 +0000 UTC m=+23.710799522" watchObservedRunningTime="2026-07-08 17:33:54.844867076 +0000 UTC m=+23.711397117"
Jul 08 17:33:55.597097 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.597065    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:55.597485 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.597067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:55.597485 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.597194    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:55.597485 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:55.597190    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:55.597485 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:55.597286    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:55.597485 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:55.597355    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:55.610847 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.610829    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:55.611381 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.611361    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:55.712999 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.712974    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 17:33:55.788504 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.788469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc" event={"ID":"474f4a6d-9857-4b22-9f41-fcc22a598d6d","Type":"ContainerStarted","Data":"b2f3cd23b9fb32ee9de20a9412c5152b50df167b6342b9ffeabedce08c75f6ea"}
Jul 08 17:33:55.788945 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.788922    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:55.789483 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:55.789465    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ntn76"
Jul 08 17:33:56.544039 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.543908    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:33:55.71299297Z","UUID":"1decad2c-a3f8-4314-8ac4-f15218702c24","Handler":null,"Name":"","Endpoint":""}
Jul 08 17:33:56.545444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.545407    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 17:33:56.545584 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.545467    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 17:33:56.793055 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.793028    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:33:56.793562 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.793360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"943e817fe36ab32a18f32ba997a759c4de9cebcbdf1e37dcf520c9a87e7d6960"}
Jul 08 17:33:56.795075 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.795003    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" event={"ID":"09b2620777e3981ec89cbd732c900e0c","Type":"ContainerStarted","Data":"3ac7696bc07c805ea9fa0b3620d0618be3ac21f5ed1e19a72be4aec5d52baebe"}
Jul 08 17:33:56.815672 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:56.815629    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-215.ec2.internal" podStartSLOduration=23.815615692 podStartE2EDuration="23.815615692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:56.815224835 +0000 UTC m=+25.681754876" watchObservedRunningTime="2026-07-08 17:33:56.815615692 +0000 UTC m=+25.682145733"
Jul 08 17:33:57.597084 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:57.596978    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:57.597258 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:57.597113    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:57.597476 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:57.597435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:57.597615 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:57.597525    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:57.597672 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:57.597633    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:33:57.597797 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:57.597769    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:58.801938 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.801802    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc" event={"ID":"474f4a6d-9857-4b22-9f41-fcc22a598d6d","Type":"ContainerStarted","Data":"b25063d8edd6634af5b1356dbe5ed4a2d915a82e6de1f5a41a8dec9214d62edb"}
Jul 08 17:33:58.805734 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.805709    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:33:58.806112 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.806086    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"d8961e4f9803f42cbbf8f95cadb9b356a42db5667f74fed43e4d82714746edea"}
Jul 08 17:33:58.806355 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.806335    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:58.806462 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.806400    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:58.806513 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.806462    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:58.806572 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.806552    2575 scope.go:117] "RemoveContainer" containerID="09bd3d563fff9454e6166d9706f30dca617d3610007cc0ce8c9bd36f8274e81d"
Jul 08 17:33:58.828313 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.828273    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lgkpc" podStartSLOduration=3.575965736 podStartE2EDuration="26.828259447s" totalImagesPullingTime="23.252293711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:58.828105163 +0000 UTC m=+27.694635239" watchObservedRunningTime="2026-07-08 17:33:58.828259447 +0000 UTC m=+27.694789490"
Jul 08 17:33:58.839876 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.839851    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:58.840181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:58.840162    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:33:59.597147 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:59.596946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:33:59.597308 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:59.596933    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:33:59.597308 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:59.597256    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:33:59.597308 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:33:59.596934    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:33:59.597498 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:59.597319    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:33:59.597498 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:33:59.597395    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:34:00.690572 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.690541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8txt"]
Jul 08 17:34:00.691004 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.690664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:00.691004 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:00.690777    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:34:00.694002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.693951    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c76z4"]
Jul 08 17:34:00.694122 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.694080    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:00.694231 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:00.694211    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:34:00.694767 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.694745    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6swbf"]
Jul 08 17:34:00.694878 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.694824    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:00.694938 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:00.694910    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:34:00.814709 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.814672    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="51ded9fbece5dee028035b884374f9c38eceb71511c9b71fb226190d430f02d1" exitCode=0
Jul 08 17:34:00.814891 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.814745    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"51ded9fbece5dee028035b884374f9c38eceb71511c9b71fb226190d430f02d1"}
Jul 08 17:34:00.818664 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.818648    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:34:00.819065 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.819040    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" event={"ID":"e76792ab-dfda-4b1a-aa06-2ddadacd7cee","Type":"ContainerStarted","Data":"0b4e622738a7b1831aac9d9a08fd8364232d03188bc0f3659650648fdfc24ed0"}
Jul 08 17:34:00.880151 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:00.880091    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs" podStartSLOduration=9.465084749 podStartE2EDuration="28.880073784s" totalImagesPullingTime="19.414989035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:00.879761666 +0000 UTC m=+29.746291708" watchObservedRunningTime="2026-07-08 17:34:00.880073784 +0000 UTC m=+29.746603828"
Jul 08 17:34:02.596811 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:02.596625    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:02.597147 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:02.596674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:02.597147 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:02.596882    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:34:02.597147 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:02.596685    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:02.597147 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:02.596958    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:34:02.597147 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:02.597036    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:34:02.825615 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:02.825526    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="cf58efda2030f5f58ec521249338456ead57dd4473fc51a63584099c4ede9045" exitCode=0
Jul 08 17:34:02.825615 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:02.825563    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"cf58efda2030f5f58ec521249338456ead57dd4473fc51a63584099c4ede9045"}
Jul 08 17:34:04.597351 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:04.597262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:04.597351 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:04.597285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:04.597351 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:04.597285    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:04.597931 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:04.597386    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-c76z4" podUID="d67ed1cd-606c-4f5c-bd57-b475a7974032"
Jul 08 17:34:04.597931 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:04.597487    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6swbf" podUID="fda9d7dc-02ef-47a3-a372-aaac7ba4151f"
Jul 08 17:34:04.597931 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:04.597581    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-t8txt" podUID="51ec67ed-7a09-4949-bc7a-0e8ea5639460"
Jul 08 17:34:04.831351 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:04.831318    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="72619ddc09b2f0a0600cb10dfe1f8a7ab3ef235c486969ee3e9b274d3d585833" exitCode=0
Jul 08 17:34:04.831519 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:04.831360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"72619ddc09b2f0a0600cb10dfe1f8a7ab3ef235c486969ee3e9b274d3d585833"}
Jul 08 17:34:05.231007 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:05.230964    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:05.231195 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.231115    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 17:34:05.231195 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.231189    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret podName:51ec67ed-7a09-4949-bc7a-0e8ea5639460 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:37.231171817 +0000 UTC m=+66.097701858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret") pod "global-pull-secret-syncer-t8txt" (UID: "51ec67ed-7a09-4949-bc7a-0e8ea5639460") : object "kube-system"/"original-pull-secret" not registered
Jul 08 17:34:05.331367 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:05.331333    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:05.331542 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.331510    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:34:05.331583 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.331572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs podName:d67ed1cd-606c-4f5c-bd57-b475a7974032 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:37.331557558 +0000 UTC m=+66.198087581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs") pod "network-metrics-daemon-c76z4" (UID: "d67ed1cd-606c-4f5c-bd57-b475a7974032") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 17:34:05.432722 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:05.432679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:05.432881 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.432841    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 17:34:05.432881 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.432861    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 17:34:05.432881 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.432870    2575 projected.go:196] Error preparing data for projected volume kube-api-access-m48mc for pod openshift-network-diagnostics/network-check-target-6swbf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:34:05.433019 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:05.432920    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc podName:fda9d7dc-02ef-47a3-a372-aaac7ba4151f nodeName:}" failed. No retries permitted until 2026-07-08 17:34:37.43290604 +0000 UTC m=+66.299436059 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m48mc" (UniqueName: "kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc") pod "network-check-target-6swbf" (UID: "fda9d7dc-02ef-47a3-a372-aaac7ba4151f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 17:34:06.450431 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.450392    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-215.ec2.internal" event="NodeReady"
Jul 08 17:34:06.450915 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.450538    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 17:34:06.498296 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.498271    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:34:06.501105 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.501084    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.503723 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.503692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 17:34:06.503812 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.503703    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5tcwq\""
Jul 08 17:34:06.503812 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.503749    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 17:34:06.503812 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.503780    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 17:34:06.509174 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.509155    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-59x8z"]
Jul 08 17:34:06.510361 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.510343    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 17:34:06.511933 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.511919    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cg55p"]
Jul 08 17:34:06.512052 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.512039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.516720 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.516696    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.516863 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.516816    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 17:34:06.516930 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.516877    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 17:34:06.517068 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.517048    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 17:34:06.517180 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.517090    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45wzh\""
Jul 08 17:34:06.520464 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.520445    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 17:34:06.520560 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.520476    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99df5\""
Jul 08 17:34:06.521278 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.521233    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 17:34:06.523984 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.523964    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:34:06.527348 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.527330    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cg55p"]
Jul 08 17:34:06.537257 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.537236    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59x8z"]
Jul 08 17:34:06.597120 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.597093    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:06.597277 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.597092    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:06.597277 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.597216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:06.599928 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.599907    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 17:34:06.600050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.599945    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 17:34:06.600050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.599961    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lzq8f\""
Jul 08 17:34:06.600050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.599907    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 17:34:06.600050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.599907    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vntcc\""
Jul 08 17:34:06.600465 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.600443    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 17:34:06.644598 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5c8z\" (UniqueName: \"kubernetes.io/projected/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-kube-api-access-x5c8z\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.644749 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644611    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.644749 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.644749 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.644868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95tdd\" (UniqueName: \"kubernetes.io/projected/b79db439-5c7f-45c3-aa04-5593d6e77f39-kube-api-access-95tdd\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.644868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-tmp-dir\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.644868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644839    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b79db439-5c7f-45c3-aa04-5593d6e77f39-cert\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.645002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxzvf\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.645002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644911    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.645002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644934    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.645002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644966    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.645002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.644989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.645193 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.645029    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-config-volume\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.645193 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.645053    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.745959 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.745881    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95tdd\" (UniqueName: \"kubernetes.io/projected/b79db439-5c7f-45c3-aa04-5593d6e77f39-kube-api-access-95tdd\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.745959 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.745919    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-tmp-dir\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.745968    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b79db439-5c7f-45c3-aa04-5593d6e77f39-cert\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.745987    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxzvf\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746015    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746038    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:06.746131    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 17:34:06.746162 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:06.746150    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4666557-g9fcp: secret "image-registry-tls" not found
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:06.746206    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls podName:0258553b-7a1c-419c-a2f0-4eb1bf37605c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:07.24618554 +0000 UTC m=+36.112715562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls") pod "image-registry-55c4666557-g9fcp" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c") : secret "image-registry-tls" not found
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746232    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746306    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-config-volume\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746358    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-tmp-dir\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746408    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5c8z\" (UniqueName: \"kubernetes.io/projected/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-kube-api-access-x5c8z\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746516 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746867 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746867 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.746867 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:06.746777    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:34:06.746867 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.746813    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-config-volume\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.746867 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:06.746819    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls podName:e18cfa2f-899e-4ba0-bdf5-7396d8013b07 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:07.246805676 +0000 UTC m=+36.113335696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls") pod "dns-default-cg55p" (UID: "e18cfa2f-899e-4ba0-bdf5-7396d8013b07") : secret "dns-default-metrics-tls" not found
Jul 08 17:34:06.747295 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.747247    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.747526 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.747494    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.750023 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.749998    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.750129 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.750074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.750202 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.750183    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b79db439-5c7f-45c3-aa04-5593d6e77f39-cert\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.754326 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.754301    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5c8z\" (UniqueName: \"kubernetes.io/projected/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-kube-api-access-x5c8z\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:06.754743 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.754724    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxzvf\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.754743 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.754738    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95tdd\" (UniqueName: \"kubernetes.io/projected/b79db439-5c7f-45c3-aa04-5593d6e77f39-kube-api-access-95tdd\") pod \"ingress-canary-59x8z\" (UID: \"b79db439-5c7f-45c3-aa04-5593d6e77f39\") " pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.755227 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.755204    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:06.824730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.824701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-59x8z"
Jul 08 17:34:06.980961 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:06.980127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-59x8z"]
Jul 08 17:34:06.983987 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:06.983956    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79db439_5c7f_45c3_aa04_5593d6e77f39.slice/crio-f8d1355a31ddef70f6b50f5fbf75ff5dba7ef7251f6bca2213e99dd9dd75a733 WatchSource:0}: Error finding container f8d1355a31ddef70f6b50f5fbf75ff5dba7ef7251f6bca2213e99dd9dd75a733: Status 404 returned error can't find the container with id f8d1355a31ddef70f6b50f5fbf75ff5dba7ef7251f6bca2213e99dd9dd75a733
Jul 08 17:34:07.250121 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:07.250091    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:07.250319 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:07.250150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:07.250319 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:07.250256    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 17:34:07.250319 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:07.250279    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4666557-g9fcp: secret "image-registry-tls" not found
Jul 08 17:34:07.250481 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:07.250328    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls podName:0258553b-7a1c-419c-a2f0-4eb1bf37605c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:08.250313044 +0000 UTC m=+37.116843063 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls") pod "image-registry-55c4666557-g9fcp" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c") : secret "image-registry-tls" not found
Jul 08 17:34:07.250481 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:07.250254    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:34:07.250481 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:07.250406    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls podName:e18cfa2f-899e-4ba0-bdf5-7396d8013b07 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:08.250385903 +0000 UTC m=+37.116915925 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls") pod "dns-default-cg55p" (UID: "e18cfa2f-899e-4ba0-bdf5-7396d8013b07") : secret "dns-default-metrics-tls" not found
Jul 08 17:34:07.840896 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:07.840852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59x8z" event={"ID":"b79db439-5c7f-45c3-aa04-5593d6e77f39","Type":"ContainerStarted","Data":"f8d1355a31ddef70f6b50f5fbf75ff5dba7ef7251f6bca2213e99dd9dd75a733"}
Jul 08 17:34:08.258319 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:08.258275    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:08.258533 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:08.258380    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:08.258606 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:08.258546    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:34:08.258661 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:08.258626    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls podName:e18cfa2f-899e-4ba0-bdf5-7396d8013b07 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.258604264 +0000 UTC m=+39.125134286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls") pod "dns-default-cg55p" (UID: "e18cfa2f-899e-4ba0-bdf5-7396d8013b07") : secret "dns-default-metrics-tls" not found
Jul 08 17:34:08.258929 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:08.258902    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 17:34:08.258929 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:08.258927    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4666557-g9fcp: secret "image-registry-tls" not found
Jul 08 17:34:08.259115 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:08.258981    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls podName:0258553b-7a1c-419c-a2f0-4eb1bf37605c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.25896484 +0000 UTC m=+39.125494867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls") pod "image-registry-55c4666557-g9fcp" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c") : secret "image-registry-tls" not found
Jul 08 17:34:09.552205 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.552173    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n4dpg"]
Jul 08 17:34:09.562812 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.562788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.566099 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.566073    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 17:34:09.566541 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.566517    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 17:34:09.566676 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.566559    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mm4vx\""
Jul 08 17:34:09.566817 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.566793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 17:34:09.566886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.566830    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 17:34:09.570331 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.570310    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n4dpg"]
Jul 08 17:34:09.674810 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.674775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ms4h\" (UniqueName: \"kubernetes.io/projected/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-api-access-7ms4h\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.674976 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.674822    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ad78ffa-9732-43f7-8e97-47529c976a22-crio-socket\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.674976 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.674850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.674976 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.674922    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad78ffa-9732-43f7-8e97-47529c976a22-data-volume\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.674976 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.674967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.775731 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.775694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.775915 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.775778    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ms4h\" (UniqueName: \"kubernetes.io/projected/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-api-access-7ms4h\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.775915 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.775808    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ad78ffa-9732-43f7-8e97-47529c976a22-crio-socket\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.775915 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.775831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.775915 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:09.775871    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:09.775915 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.775903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad78ffa-9732-43f7-8e97-47529c976a22-data-volume\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.776149 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:09.775946    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.275925407 +0000 UTC m=+39.142455446 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:09.776149 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:09.775971    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:34:09.776149 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:09.776031    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.276016682 +0000 UTC m=+39.142546708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : configmap "kube-rbac-proxy" not found
Jul 08 17:34:09.776149 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.776075    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0ad78ffa-9732-43f7-8e97-47529c976a22-crio-socket\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.776310 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.776241    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0ad78ffa-9732-43f7-8e97-47529c976a22-data-volume\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:09.790933 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:09.790907    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ms4h\" (UniqueName: \"kubernetes.io/projected/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-api-access-7ms4h\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:10.281012 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.280935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:10.281012 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.280991    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:10.281194 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.281029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:10.281194 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.281064    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:10.281194 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281068    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:34:10.281194 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281141    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:11.281121319 +0000 UTC m=+40.147651339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : configmap "kube-rbac-proxy" not found
Jul 08 17:34:10.281194 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281181    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281239    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:11.281226677 +0000 UTC m=+40.147756697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281269    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281289    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4666557-g9fcp: secret "image-registry-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281337    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls podName:0258553b-7a1c-419c-a2f0-4eb1bf37605c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:14.2813249 +0000 UTC m=+43.147854925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls") pod "image-registry-55c4666557-g9fcp" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c") : secret "image-registry-tls" not found
Jul 08 17:34:10.281437 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:10.281360    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls podName:e18cfa2f-899e-4ba0-bdf5-7396d8013b07 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:14.281352397 +0000 UTC m=+43.147882416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls") pod "dns-default-cg55p" (UID: "e18cfa2f-899e-4ba0-bdf5-7396d8013b07") : secret "dns-default-metrics-tls" not found
Jul 08 17:34:10.848546 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.848217    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-59x8z" event={"ID":"b79db439-5c7f-45c3-aa04-5593d6e77f39","Type":"ContainerStarted","Data":"e9b29c8bc6b8c6bdcb69e56a242c98e12ca1c0a1c706b56a41a0152390a9ca99"}
Jul 08 17:34:10.850816 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.850791    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="f05daa08b95fd789c26dd072b7cbb7e8a9e6bae55caf1289849f344b0830baab" exitCode=0
Jul 08 17:34:10.850940 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.850837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"f05daa08b95fd789c26dd072b7cbb7e8a9e6bae55caf1289849f344b0830baab"}
Jul 08 17:34:10.876313 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:10.876262    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-59x8z" podStartSLOduration=1.382044172 podStartE2EDuration="4.87624867s" totalImagesPullingTime="3.494204498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:10.87573618 +0000 UTC m=+39.742266255" watchObservedRunningTime="2026-07-08 17:34:10.87624867 +0000 UTC m=+39.742778712"
Jul 08 17:34:11.289947 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:11.289887    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:11.290145 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:11.289994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:11.290145 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:11.290010    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 17:34:11.290145 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:11.290076    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:13.290063033 +0000 UTC m=+42.156593052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : configmap "kube-rbac-proxy" not found
Jul 08 17:34:11.290145 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:11.290109    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:11.290276 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:11.290159    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:13.290147048 +0000 UTC m=+42.156677069 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:11.856880 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:11.856841    2575 generic.go:356] "Generic (PLEG): container finished" podID="b829f001-c40d-4f7b-9e34-6edf82de7996" containerID="1caa56ea3e68a3ad53b1fd4f88a12626def38c4a09926ee6c79b660e00724e68" exitCode=0
Jul 08 17:34:11.857324 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:11.856920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerDied","Data":"1caa56ea3e68a3ad53b1fd4f88a12626def38c4a09926ee6c79b660e00724e68"}
Jul 08 17:34:12.463606 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:12.463576    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjwjh_376e6366-2e23-47bd-90bb-af0d14c74f3c/dns-node-resolver/0.log"
Jul 08 17:34:12.862955 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:12.862923    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-thq8l" event={"ID":"b829f001-c40d-4f7b-9e34-6edf82de7996","Type":"ContainerStarted","Data":"8ff00b29188603072638628dfb62cecd3deb5a862281f86d8df0254fd8e36a6a"}
Jul 08 17:34:12.892750 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:12.892677    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-thq8l" podStartSLOduration=6.389053681 podStartE2EDuration="40.89265731s" totalImagesPullingTime="34.503603629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:12.892597352 +0000 UTC m=+41.759127406" watchObservedRunningTime="2026-07-08 17:34:12.89265731 +0000 UTC m=+41.759187347"
Jul 08 17:34:13.060648 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:13.060618    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmj4c_0a77fb5b-7fff-402b-b1a4-74d4e62e2729/node-ca/0.log"
Jul 08 17:34:13.306226 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:13.306140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:13.306226 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:13.306216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:13.306471 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:13.306321    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:13.306471 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:13.306371    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:17.30635791 +0000 UTC m=+46.172887929 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:13.306839 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:13.306814    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0ad78ffa-9732-43f7-8e97-47529c976a22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:13.859475 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:13.859448    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59x8z_b79db439-5c7f-45c3-aa04-5593d6e77f39/serve-healthcheck-canary/0.log"
Jul 08 17:34:14.312057 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:14.312008    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:14.312701 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:14.312676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:14.312981 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:14.312965    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 17:34:14.313074 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:14.313065    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55c4666557-g9fcp: secret "image-registry-tls" not found
Jul 08 17:34:14.313198 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:14.313189    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls podName:0258553b-7a1c-419c-a2f0-4eb1bf37605c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:22.313162776 +0000 UTC m=+51.179692799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls") pod "image-registry-55c4666557-g9fcp" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c") : secret "image-registry-tls" not found
Jul 08 17:34:14.313801 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:14.313780    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 17:34:14.313974 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:14.313963    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls podName:e18cfa2f-899e-4ba0-bdf5-7396d8013b07 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:22.313938161 +0000 UTC m=+51.180468198 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls") pod "dns-default-cg55p" (UID: "e18cfa2f-899e-4ba0-bdf5-7396d8013b07") : secret "dns-default-metrics-tls" not found
Jul 08 17:34:17.334578 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:17.334533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:17.334967 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:17.334648    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:17.334967 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:34:17.334710    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls podName:0ad78ffa-9732-43f7-8e97-47529c976a22 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:25.334695211 +0000 UTC m=+54.201225232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n4dpg" (UID: "0ad78ffa-9732-43f7-8e97-47529c976a22") : secret "insights-runtime-extractor-tls" not found
Jul 08 17:34:22.371531 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.371498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:22.371993 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.371587    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:22.375052 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.375018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"image-registry-55c4666557-g9fcp\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") " pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:22.377254 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.377231    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e18cfa2f-899e-4ba0-bdf5-7396d8013b07-metrics-tls\") pod \"dns-default-cg55p\" (UID: \"e18cfa2f-899e-4ba0-bdf5-7396d8013b07\") " pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:22.410932 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.410903    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:22.431967 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.431946    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:22.600838 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.600788    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:34:22.603306 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:22.603281    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0258553b_7a1c_419c_a2f0_4eb1bf37605c.slice/crio-baf49d85acffc85a3edb3835eb71f47f815d3c53badb7b851fdc843fc305ee86 WatchSource:0}: Error finding container baf49d85acffc85a3edb3835eb71f47f815d3c53badb7b851fdc843fc305ee86: Status 404 returned error can't find the container with id baf49d85acffc85a3edb3835eb71f47f815d3c53badb7b851fdc843fc305ee86
Jul 08 17:34:22.614091 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.614064    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cg55p"]
Jul 08 17:34:22.627441 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:22.627372    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18cfa2f_899e_4ba0_bdf5_7396d8013b07.slice/crio-754b1d429c152c90ab40a303cdfdf1b93003286bca4595cf6c3e9c4e11d3edf6 WatchSource:0}: Error finding container 754b1d429c152c90ab40a303cdfdf1b93003286bca4595cf6c3e9c4e11d3edf6: Status 404 returned error can't find the container with id 754b1d429c152c90ab40a303cdfdf1b93003286bca4595cf6c3e9c4e11d3edf6
Jul 08 17:34:22.888461 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.888365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg55p" event={"ID":"e18cfa2f-899e-4ba0-bdf5-7396d8013b07","Type":"ContainerStarted","Data":"754b1d429c152c90ab40a303cdfdf1b93003286bca4595cf6c3e9c4e11d3edf6"}
Jul 08 17:34:22.889785 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.889756    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerStarted","Data":"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"}
Jul 08 17:34:22.889921 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.889804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerStarted","Data":"baf49d85acffc85a3edb3835eb71f47f815d3c53badb7b851fdc843fc305ee86"}
Jul 08 17:34:22.889921 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.889842    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:34:22.911772 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:22.911721    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podStartSLOduration=53.911704924 podStartE2EDuration="53.911704924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:22.911135425 +0000 UTC m=+51.777665468" watchObservedRunningTime="2026-07-08 17:34:22.911704924 +0000 UTC m=+51.778234965"
Jul 08 17:34:25.395183 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.395140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:25.397512 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.397486    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0ad78ffa-9732-43f7-8e97-47529c976a22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n4dpg\" (UID: \"0ad78ffa-9732-43f7-8e97-47529c976a22\") " pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:25.473975 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.473870    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n4dpg"
Jul 08 17:34:25.625025 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.624994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n4dpg"]
Jul 08 17:34:25.628495 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:25.628467    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad78ffa_9732_43f7_8e97_47529c976a22.slice/crio-0229f459908fd7268fcad4043c48a6b0189cae0bb58104d8fc282cb7c0dbb912 WatchSource:0}: Error finding container 0229f459908fd7268fcad4043c48a6b0189cae0bb58104d8fc282cb7c0dbb912: Status 404 returned error can't find the container with id 0229f459908fd7268fcad4043c48a6b0189cae0bb58104d8fc282cb7c0dbb912
Jul 08 17:34:25.899435 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.899325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg55p" event={"ID":"e18cfa2f-899e-4ba0-bdf5-7396d8013b07","Type":"ContainerStarted","Data":"a3dcdee210af908ff3ec128cf3919f391ac6aad4eb07fbe4953bdcfe7fe3a8df"}
Jul 08 17:34:25.899435 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.899388    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:25.899435 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.899427    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cg55p" event={"ID":"e18cfa2f-899e-4ba0-bdf5-7396d8013b07","Type":"ContainerStarted","Data":"3bde41cf96523b062813604209d2c8ec7351f4fcffc237e30f279ab672ed872d"}
Jul 08 17:34:25.900364 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.900343    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4dpg" event={"ID":"0ad78ffa-9732-43f7-8e97-47529c976a22","Type":"ContainerStarted","Data":"0229f459908fd7268fcad4043c48a6b0189cae0bb58104d8fc282cb7c0dbb912"}
Jul 08 17:34:25.917652 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:25.917599    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cg55p" podStartSLOduration=17.071297346 podStartE2EDuration="19.917580473s" totalImagesPullingTime="2.846283127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:25.916439961 +0000 UTC m=+54.782970003" watchObservedRunningTime="2026-07-08 17:34:25.917580473 +0000 UTC m=+54.784110515"
Jul 08 17:34:29.916715 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:29.916676    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4dpg" event={"ID":"0ad78ffa-9732-43f7-8e97-47529c976a22","Type":"ContainerStarted","Data":"65a4fdef2024eaf5fe3c552ba97ac604b4384883692203f29cc24542f8a38f31"}
Jul 08 17:34:30.920775 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:30.920740    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4dpg" event={"ID":"0ad78ffa-9732-43f7-8e97-47529c976a22","Type":"ContainerStarted","Data":"7228b5124053d375c1ff3adf639a34cb2072370279f374522f35a0f7b303987c"}
Jul 08 17:34:31.832728 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:31.832695    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4zpzs"
Jul 08 17:34:33.933535 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:33.933501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n4dpg" event={"ID":"0ad78ffa-9732-43f7-8e97-47529c976a22","Type":"ContainerStarted","Data":"e174249039e4a16f53e5356d9781fba75bba53653d64bfd2973992e7db909140"}
Jul 08 17:34:33.953707 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:33.953657    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n4dpg" podStartSLOduration=17.278772926 podStartE2EDuration="24.95364125s" totalImagesPullingTime="7.674868324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:34:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:33.952630695 +0000 UTC m=+62.819160794" watchObservedRunningTime="2026-07-08 17:34:33.95364125 +0000 UTC m=+62.820171292"
Jul 08 17:34:35.906045 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:35.906018    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cg55p"
Jul 08 17:34:37.279070 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.279023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:37.282109 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.282089    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 17:34:37.291461 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.291433    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/51ec67ed-7a09-4949-bc7a-0e8ea5639460-original-pull-secret\") pod \"global-pull-secret-syncer-t8txt\" (UID: \"51ec67ed-7a09-4949-bc7a-0e8ea5639460\") " pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:37.379813 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.379770    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:37.382745 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.382729    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 17:34:37.392213 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.392186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d67ed1cd-606c-4f5c-bd57-b475a7974032-metrics-certs\") pod \"network-metrics-daemon-c76z4\" (UID: \"d67ed1cd-606c-4f5c-bd57-b475a7974032\") " pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:37.480139 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.480092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:37.483675 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.483656    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 17:34:37.496331 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.496312    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 17:34:37.504032 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.504005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48mc\" (UniqueName: \"kubernetes.io/projected/fda9d7dc-02ef-47a3-a372-aaac7ba4151f-kube-api-access-m48mc\") pod \"network-check-target-6swbf\" (UID: \"fda9d7dc-02ef-47a3-a372-aaac7ba4151f\") " pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:37.512275 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.512256    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vntcc\""
Jul 08 17:34:37.517460 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.517433    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-t8txt"
Jul 08 17:34:37.520712 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.520693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:37.526124 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.526106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lzq8f\""
Jul 08 17:34:37.533655 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.533559    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-c76z4"
Jul 08 17:34:37.666561 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.666535    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6swbf"]
Jul 08 17:34:37.670306 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:37.670265    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda9d7dc_02ef_47a3_a372_aaac7ba4151f.slice/crio-d269c8699403cfe65f83aae74c63fddc0c9874d682e9923fd8073b89a21cb6fa WatchSource:0}: Error finding container d269c8699403cfe65f83aae74c63fddc0c9874d682e9923fd8073b89a21cb6fa: Status 404 returned error can't find the container with id d269c8699403cfe65f83aae74c63fddc0c9874d682e9923fd8073b89a21cb6fa
Jul 08 17:34:37.677381 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.677358    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-t8txt"]
Jul 08 17:34:37.680119 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:37.680098    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ec67ed_7a09_4949_bc7a_0e8ea5639460.slice/crio-e5c68e6a5858e70e7618007f2e60d8f54e25e40149786e24a2ebd232fbf7f975 WatchSource:0}: Error finding container e5c68e6a5858e70e7618007f2e60d8f54e25e40149786e24a2ebd232fbf7f975: Status 404 returned error can't find the container with id e5c68e6a5858e70e7618007f2e60d8f54e25e40149786e24a2ebd232fbf7f975
Jul 08 17:34:37.702171 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.702142    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-c76z4"]
Jul 08 17:34:37.706056 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:34:37.706026    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67ed1cd_606c_4f5c_bd57_b475a7974032.slice/crio-91a0fbf7860ea0f44ff725ef96055d3a05f123fb1d7accb4c6d52f465a946955 WatchSource:0}: Error finding container 91a0fbf7860ea0f44ff725ef96055d3a05f123fb1d7accb4c6d52f465a946955: Status 404 returned error can't find the container with id 91a0fbf7860ea0f44ff725ef96055d3a05f123fb1d7accb4c6d52f465a946955
Jul 08 17:34:37.945965 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.945930    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6swbf" event={"ID":"fda9d7dc-02ef-47a3-a372-aaac7ba4151f","Type":"ContainerStarted","Data":"d269c8699403cfe65f83aae74c63fddc0c9874d682e9923fd8073b89a21cb6fa"}
Jul 08 17:34:37.947027 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.946999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c76z4" event={"ID":"d67ed1cd-606c-4f5c-bd57-b475a7974032","Type":"ContainerStarted","Data":"91a0fbf7860ea0f44ff725ef96055d3a05f123fb1d7accb4c6d52f465a946955"}
Jul 08 17:34:37.948028 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:37.947999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8txt" event={"ID":"51ec67ed-7a09-4949-bc7a-0e8ea5639460","Type":"ContainerStarted","Data":"e5c68e6a5858e70e7618007f2e60d8f54e25e40149786e24a2ebd232fbf7f975"}
Jul 08 17:34:41.968103 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:41.968064    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6swbf" event={"ID":"fda9d7dc-02ef-47a3-a372-aaac7ba4151f","Type":"ContainerStarted","Data":"e33946a0f8345d0b7e5963b26793a91476fe3f6d3cd23337949caf26aaa9f3bd"}
Jul 08 17:34:41.968585 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:41.968192    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:34:41.993227 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:41.993164    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6swbf" podStartSLOduration=66.559650616 podStartE2EDuration="1m9.993146754s" totalImagesPullingTime="3.433496138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:41.992705005 +0000 UTC m=+70.859235070" watchObservedRunningTime="2026-07-08 17:34:41.993146754 +0000 UTC m=+70.859676777"
Jul 08 17:34:42.415646 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:42.415601    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:34:42.415822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:42.415660    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:34:43.898837 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.898804    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:34:43.899213 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.898853    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:34:43.975552 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.975512    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-t8txt" event={"ID":"51ec67ed-7a09-4949-bc7a-0e8ea5639460","Type":"ContainerStarted","Data":"7e4da4729faec32e21cd09de2a0809c2786116693d9eb5ed0ce220fed4befc1a"}
Jul 08 17:34:43.977135 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.977105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c76z4" event={"ID":"d67ed1cd-606c-4f5c-bd57-b475a7974032","Type":"ContainerStarted","Data":"8f011f102ef715ef46ccb42b3f56e122045003ea90f4fe8dd08393bb199bad68"}
Jul 08 17:34:43.977264 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.977150    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-c76z4" event={"ID":"d67ed1cd-606c-4f5c-bd57-b475a7974032","Type":"ContainerStarted","Data":"746f742b910fe6b368521b526dde279ff4a8f741ff1812ad4eee85fc86f7093a"}
Jul 08 17:34:43.996484 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:43.996439    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-t8txt" podStartSLOduration=66.588138099 podStartE2EDuration="1m11.996404112s" totalImagesPullingTime="5.408266013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:43.995113086 +0000 UTC m=+72.861643128" watchObservedRunningTime="2026-07-08 17:34:43.996404112 +0000 UTC m=+72.862934153"
Jul 08 17:34:44.012885 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:44.012832    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-c76z4" podStartSLOduration=66.637229739 podStartE2EDuration="1m12.012814025s" totalImagesPullingTime="5.375584286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:44.011830003 +0000 UTC m=+72.878360103" watchObservedRunningTime="2026-07-08 17:34:44.012814025 +0000 UTC m=+72.879344071"
Jul 08 17:34:52.415023 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:52.414985    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:34:52.415517 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:52.415046    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:34:53.896714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:53.896590    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:34:53.896714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:34:53.896643    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:35:02.415375 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.415340    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:35:02.415853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.415401    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:35:02.415853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.415463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:02.415926 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.415861    2575 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"} pod="openshift-image-registry/image-registry-55c4666557-g9fcp" containerMessage="Container registry failed liveness probe, will be restarted"
Jul 08 17:35:02.419382 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.419351    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:35:02.419521 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:02.419428    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:35:10.144571 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.144537    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"]
Jul 08 17:35:10.172977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.172950    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"]
Jul 08 17:35:10.173129 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.173047    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.177350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.177316    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 17:35:10.177350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.177316    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 17:35:10.177876 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.177860    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 08 17:35:10.177977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.177876    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 08 17:35:10.179982 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.179958    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 08 17:35:10.181065 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.181045    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 17:35:10.183451 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.183410    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 08 17:35:10.299886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.299886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnjgs\" (UniqueName: \"kubernetes.io/projected/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-kube-api-access-tnjgs\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.299886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.300105 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299917    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.300105 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.300105 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.299994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.319477 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.319432    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:35:10.400271 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400236    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.400444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.400444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.400444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnjgs\" (UniqueName: \"kubernetes.io/projected/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-kube-api-access-tnjgs\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.400444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400370    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.400444 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.400401    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.401165 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.401134    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.403194 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.403165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-ca\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.403194 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.403164    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.403349 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.403231    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.403349 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.403245    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.412885 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.412861    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnjgs\" (UniqueName: \"kubernetes.io/projected/ac8cbe1f-0157-4607-a9f4-4a5c2db244f5-kube-api-access-tnjgs\") pod \"cluster-proxy-proxy-agent-f88c75646-dhz4n\" (UID: \"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.447146 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.447119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7644c96b88-z49vh"]
Jul 08 17:35:10.450451 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.450436    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.488856 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.488833    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"
Jul 08 17:35:10.491041 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.491018    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7644c96b88-z49vh"]
Jul 08 17:35:10.601389 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601356    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86ca89a8-5557-431a-8241-f01db8e5b0f3-ca-trust-extracted\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601389 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601398    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-bound-sa-token\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601650 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrzsh\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-kube-api-access-nrzsh\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601650 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601533    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-trusted-ca\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601650 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601573    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-image-registry-private-configuration\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601765 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-tls\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601765 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-installation-pull-secrets\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.601765 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.601702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-certificates\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.624181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.624154    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n"]
Jul 08 17:35:10.627189 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:35:10.627164    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac8cbe1f_0157_4607_a9f4_4a5c2db244f5.slice/crio-91b6231f46e9c89eb3a8be3e8b756768bc484f11952ee2e63d55136d010ed067 WatchSource:0}: Error finding container 91b6231f46e9c89eb3a8be3e8b756768bc484f11952ee2e63d55136d010ed067: Status 404 returned error can't find the container with id 91b6231f46e9c89eb3a8be3e8b756768bc484f11952ee2e63d55136d010ed067
Jul 08 17:35:10.702106 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702070    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-certificates\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702106 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702112    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86ca89a8-5557-431a-8241-f01db8e5b0f3-ca-trust-extracted\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702330 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702132    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-bound-sa-token\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702330 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrzsh\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-kube-api-access-nrzsh\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702330 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702187    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-trusted-ca\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702513 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702339    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-image-registry-private-configuration\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702513 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-tls\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702513 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-installation-pull-secrets\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.702625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.702566    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86ca89a8-5557-431a-8241-f01db8e5b0f3-ca-trust-extracted\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.703134 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.703107    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-certificates\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.703279 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.703228    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86ca89a8-5557-431a-8241-f01db8e5b0f3-trusted-ca\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.704861 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.704834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-registry-tls\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.704957 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.704929    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-image-registry-private-configuration\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.704996 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.704970    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86ca89a8-5557-431a-8241-f01db8e5b0f3-installation-pull-secrets\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.710987 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.710965    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-bound-sa-token\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.711086 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.711042    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrzsh\" (UniqueName: \"kubernetes.io/projected/86ca89a8-5557-431a-8241-f01db8e5b0f3-kube-api-access-nrzsh\") pod \"image-registry-7644c96b88-z49vh\" (UID: \"86ca89a8-5557-431a-8241-f01db8e5b0f3\") " pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.758222 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.758182    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:10.893179 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:10.893149    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7644c96b88-z49vh"]
Jul 08 17:35:10.895783 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:35:10.895759    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ca89a8_5557_431a_8241_f01db8e5b0f3.slice/crio-f152715b80afd93ca4fcedcba8fb3f446c56c55a83bf52ce2f4510b137a35058 WatchSource:0}: Error finding container f152715b80afd93ca4fcedcba8fb3f446c56c55a83bf52ce2f4510b137a35058: Status 404 returned error can't find the container with id f152715b80afd93ca4fcedcba8fb3f446c56c55a83bf52ce2f4510b137a35058
Jul 08 17:35:11.059945 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:11.059907    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7644c96b88-z49vh" event={"ID":"86ca89a8-5557-431a-8241-f01db8e5b0f3","Type":"ContainerStarted","Data":"f746b70c1ab2f5fb8aebaaee24390257c7277bccd4fdf95dfc4836a04c6ff819"}
Jul 08 17:35:11.060134 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:11.059999    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7644c96b88-z49vh" event={"ID":"86ca89a8-5557-431a-8241-f01db8e5b0f3","Type":"ContainerStarted","Data":"f152715b80afd93ca4fcedcba8fb3f446c56c55a83bf52ce2f4510b137a35058"}
Jul 08 17:35:11.060134 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:11.060029    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:11.061064 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:11.061041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n" event={"ID":"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5","Type":"ContainerStarted","Data":"91b6231f46e9c89eb3a8be3e8b756768bc484f11952ee2e63d55136d010ed067"}
Jul 08 17:35:11.091369 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:11.091286    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7644c96b88-z49vh" podStartSLOduration=1.091271344 podStartE2EDuration="1.091271344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:11.089742511 +0000 UTC m=+99.956272567" watchObservedRunningTime="2026-07-08 17:35:11.091271344 +0000 UTC m=+99.957801385"
Jul 08 17:35:12.420032 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:12.419988    2575 patch_prober.go:28] interesting pod/image-registry-55c4666557-g9fcp container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 08 17:35:12.420410 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:12.420049    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:35:12.973791 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:12.973757    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6swbf"
Jul 08 17:35:17.084778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:17.084682    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n" event={"ID":"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5","Type":"ContainerStarted","Data":"130695cd2f1e7cc181c282fa3f9b5ccd1b3b0a669008fe41354451eaa6e1134c"}
Jul 08 17:35:17.084778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:17.084731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n" event={"ID":"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5","Type":"ContainerStarted","Data":"673814039fa4a2dcdd44868b152cac9c96645ec065fc9b3bdd13d0fb34aa5612"}
Jul 08 17:35:17.084778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:17.084748    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n" event={"ID":"ac8cbe1f-0157-4607-a9f4-4a5c2db244f5","Type":"ContainerStarted","Data":"366263d5e05d1ddc442d57081dc656163b9c69bbba4e5db7edd8e6f49a5cc704"}
Jul 08 17:35:17.110336 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:17.110290    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f88c75646-dhz4n" podStartSLOduration=1.116410281 podStartE2EDuration="7.110250731s" totalImagesPullingTime="5.99384045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:17.109389423 +0000 UTC m=+105.975919464" watchObservedRunningTime="2026-07-08 17:35:17.110250731 +0000 UTC m=+105.976780773"
Jul 08 17:35:20.234318 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.234267    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6scpj"]
Jul 08 17:35:20.239833 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.239801    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.242394 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.242367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 17:35:20.242528 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.242407    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 17:35:20.243246 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.243224    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 17:35:20.243488 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.243473    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 17:35:20.243583 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.243565    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zcdmt\""
Jul 08 17:35:20.243788 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.243775    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 17:35:20.243930 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.243882    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 17:35:20.380433 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-sys\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-accelerators-collector-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-metrics-client-ca\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380553    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc7n8\" (UniqueName: \"kubernetes.io/projected/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-kube-api-access-dc7n8\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380625 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380594    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-root\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380788 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380651    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-textfile\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380788 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.380788 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.380704    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-wtmp\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481300    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-textfile\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481350 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481383    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-wtmp\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-sys\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-accelerators-collector-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481512    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-sys\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-metrics-client-ca\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:35:20.481553    2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-wtmp\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481595 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481908 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:35:20.481618    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls podName:dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869 nodeName:}" failed. No retries permitted until 2026-07-08 17:35:20.981597983 +0000 UTC m=+109.848128016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls") pod "node-exporter-6scpj" (UID: "dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869") : secret "node-exporter-tls" not found
Jul 08 17:35:20.481908 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc7n8\" (UniqueName: \"kubernetes.io/projected/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-kube-api-access-dc7n8\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481908 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481685    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-root\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481908 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-textfile\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.481908 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.481768    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-root\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.482071 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.482011    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-metrics-client-ca\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.482071 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.482041    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-accelerators-collector-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.483862 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.483838    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.494061 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.494005    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc7n8\" (UniqueName: \"kubernetes.io/projected/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-kube-api-access-dc7n8\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.986941 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.986903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:20.989223 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:20.989196    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869-node-exporter-tls\") pod \"node-exporter-6scpj\" (UID: \"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869\") " pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:21.149077 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:21.149035    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6scpj"
Jul 08 17:35:21.160776 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:35:21.160747    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2b25d2_fe1c_4ebb_95da_2e55d7bf6869.slice/crio-3ea6bc1b071b577c3e6728ff2c160e65e862f94ebbd2821ca0c45e601b9b328b WatchSource:0}: Error finding container 3ea6bc1b071b577c3e6728ff2c160e65e862f94ebbd2821ca0c45e601b9b328b: Status 404 returned error can't find the container with id 3ea6bc1b071b577c3e6728ff2c160e65e862f94ebbd2821ca0c45e601b9b328b
Jul 08 17:35:22.101354 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:22.101315    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6scpj" event={"ID":"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869","Type":"ContainerStarted","Data":"3ea6bc1b071b577c3e6728ff2c160e65e862f94ebbd2821ca0c45e601b9b328b"}
Jul 08 17:35:22.420778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:22.420747    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:23.106182 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:23.106095    2575 generic.go:356] "Generic (PLEG): container finished" podID="dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869" containerID="73298cec10c874e0b6cf625c97486caec70345a5dcdaaa7f3c0718dde269d668" exitCode=0
Jul 08 17:35:23.106182 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:23.106160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6scpj" event={"ID":"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869","Type":"ContainerDied","Data":"73298cec10c874e0b6cf625c97486caec70345a5dcdaaa7f3c0718dde269d668"}
Jul 08 17:35:24.111914 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:24.111872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6scpj" event={"ID":"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869","Type":"ContainerStarted","Data":"208eb2ee8dc83e068f77296273e0597fdd7bad6d184e4e7b0be3fcd9fe7bcbb1"}
Jul 08 17:35:24.112301 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:24.111940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6scpj" event={"ID":"dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869","Type":"ContainerStarted","Data":"52ec90836eaed33d1df3f7ffc872852d3a7845ae442c66b8e412ffbe77e75cca"}
Jul 08 17:35:24.134354 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:24.134309    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6scpj" podStartSLOduration=2.515525368 podStartE2EDuration="4.134295804s" totalImagesPullingTime="1.556026026s" totalInitContainerRuntime="62.74441ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:24.132975628 +0000 UTC m=+112.999505702" watchObservedRunningTime="2026-07-08 17:35:24.134295804 +0000 UTC m=+113.000825843"
Jul 08 17:35:27.434825 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:27.434783    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" containerID="cri-o://f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5" gracePeriod=30
Jul 08 17:35:28.126463 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:28.126407    2575 generic.go:356] "Generic (PLEG): container finished" podID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerID="f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5" exitCode=0
Jul 08 17:35:28.126642 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:28.126475    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerDied","Data":"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"}
Jul 08 17:35:28.126642 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:28.126514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerStarted","Data":"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"}
Jul 08 17:35:28.126642 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:28.126608    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:32.069938 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:32.069911    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7644c96b88-z49vh"
Jul 08 17:35:48.131365 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:48.131339    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:53.145621 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.145555    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry" containerID="cri-o://5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35" gracePeriod=30
Jul 08 17:35:53.394086 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.394060    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:53.434004 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.433933    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434004 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.433981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434018    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434044    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxzvf\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434072    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434101    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434136    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token\") pod \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\" (UID: \"0258553b-7a1c-419c-a2f0-4eb1bf37605c\") "
Jul 08 17:35:53.434651 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434590    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:35:53.434651 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.434633    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:35:53.436711 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.436678    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:35:53.436827 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.436736    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:35:53.436827 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.436805    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:35:53.436912 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.436839    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:35:53.436946 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.436898    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf" (OuterVolumeSpecName: "kube-api-access-nxzvf") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "kube-api-access-nxzvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:35:53.444138 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.444116    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0258553b-7a1c-419c-a2f0-4eb1bf37605c" (UID: "0258553b-7a1c-419c-a2f0-4eb1bf37605c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:35:53.535041 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535014    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-bound-sa-token\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535041 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535039    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0258553b-7a1c-419c-a2f0-4eb1bf37605c-ca-trust-extracted\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535050    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-image-registry-private-configuration\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535059    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535067    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxzvf\" (UniqueName: \"kubernetes.io/projected/0258553b-7a1c-419c-a2f0-4eb1bf37605c-kube-api-access-nxzvf\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535076    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-trusted-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535084    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0258553b-7a1c-419c-a2f0-4eb1bf37605c-registry-certificates\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:53.535198 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:53.535092    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0258553b-7a1c-419c-a2f0-4eb1bf37605c-installation-pull-secrets\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:35:54.216051 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.216016    2575 generic.go:356] "Generic (PLEG): container finished" podID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerID="5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35" exitCode=0
Jul 08 17:35:54.216709 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.216059    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55c4666557-g9fcp"
Jul 08 17:35:54.216709 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.216107    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerDied","Data":"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"}
Jul 08 17:35:54.216709 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.216160    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55c4666557-g9fcp" event={"ID":"0258553b-7a1c-419c-a2f0-4eb1bf37605c","Type":"ContainerDied","Data":"baf49d85acffc85a3edb3835eb71f47f815d3c53badb7b851fdc843fc305ee86"}
Jul 08 17:35:54.216709 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.216187    2575 scope.go:117] "RemoveContainer" containerID="5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"
Jul 08 17:35:54.224559 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.224542    2575 scope.go:117] "RemoveContainer" containerID="f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"
Jul 08 17:35:54.231057 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.231040    2575 scope.go:117] "RemoveContainer" containerID="5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"
Jul 08 17:35:54.231333 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:35:54.231315    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35\": container with ID starting with 5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35 not found: ID does not exist" containerID="5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"
Jul 08 17:35:54.231396 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.231340    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35"} err="failed to get container status \"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35\": rpc error: code = NotFound desc = could not find container \"5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35\": container with ID starting with 5215eea1dce97cc041623078dae506d00cf75dff054d50133c16de8cdce9cd35 not found: ID does not exist"
Jul 08 17:35:54.231396 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.231356    2575 scope.go:117] "RemoveContainer" containerID="f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"
Jul 08 17:35:54.231598 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:35:54.231575    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5\": container with ID starting with f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5 not found: ID does not exist" containerID="f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"
Jul 08 17:35:54.231643 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.231606    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5"} err="failed to get container status \"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5\": rpc error: code = NotFound desc = could not find container \"f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5\": container with ID starting with f519ce8dc747fe73352b3a0867b802e20ef30ecf270f0e29546dd528dc3081a5 not found: ID does not exist"
Jul 08 17:35:54.234717 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.234699    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:35:54.238787 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:54.238766    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55c4666557-g9fcp"]
Jul 08 17:35:55.601412 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:35:55.601375    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" path="/var/lib/kubelet/pods/0258553b-7a1c-419c-a2f0-4eb1bf37605c/volumes"
Jul 08 17:36:28.097220 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097131    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:36:28.097815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097487    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:36:28.097815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097509    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:36:28.097815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097524    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:36:28.097815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097531    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:36:28.097815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.097584    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:36:28.100540 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.100512    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.103229 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.103211    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 17:36:28.103349 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.103211    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 17:36:28.103349 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.103213    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 17:36:28.104352 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.104328    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 17:36:28.104482 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.104350    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 17:36:28.104482 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.104365    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 17:36:28.104482 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.104350    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5xjd7\""
Jul 08 17:36:28.104482 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.104371    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 17:36:28.108592 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.108575    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 17:36:28.110178 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.110161    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:36:28.278587 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278538    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278587 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278618    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278669    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.278853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.278820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxhnw\" (UniqueName: \"kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379301 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379508 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379309    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxhnw\" (UniqueName: \"kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379508 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379345    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379508 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379368    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379508 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379719 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379549    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.379719 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.379613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.380086 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.380060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.380216 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.380192    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.380216 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.380204    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.380385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.380369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.382347 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.382320    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.382556 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.382537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.388041 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.388014    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxhnw\" (UniqueName: \"kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw\") pod \"console-d97b8566d-nq9k6\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") " pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.409701 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.409678    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:28.537007 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:28.536861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:36:28.539487 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:36:28.539457    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755c2b7c_42dd_40ba_8d1c_f057708512ce.slice/crio-e02807e656b21dbdac39e3c4364ff6a39a7d5344ac1e85fc41d4cbe4e0f2d097 WatchSource:0}: Error finding container e02807e656b21dbdac39e3c4364ff6a39a7d5344ac1e85fc41d4cbe4e0f2d097: Status 404 returned error can't find the container with id e02807e656b21dbdac39e3c4364ff6a39a7d5344ac1e85fc41d4cbe4e0f2d097
Jul 08 17:36:29.331731 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:29.331694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97b8566d-nq9k6" event={"ID":"755c2b7c-42dd-40ba-8d1c-f057708512ce","Type":"ContainerStarted","Data":"e02807e656b21dbdac39e3c4364ff6a39a7d5344ac1e85fc41d4cbe4e0f2d097"}
Jul 08 17:36:32.343331 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:32.343292    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97b8566d-nq9k6" event={"ID":"755c2b7c-42dd-40ba-8d1c-f057708512ce","Type":"ContainerStarted","Data":"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"}
Jul 08 17:36:32.368619 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:32.368562    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d97b8566d-nq9k6" podStartSLOduration=1.114699936 podStartE2EDuration="4.368547191s" totalImagesPullingTime="3.253847255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:36:32.368143894 +0000 UTC m=+181.234673933" watchObservedRunningTime="2026-07-08 17:36:32.368547191 +0000 UTC m=+181.235077232"
Jul 08 17:36:38.410119 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:38.410079    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:38.410730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:38.410164    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:38.414567 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:38.414545    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:36:39.372875 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:36:39.372841    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:38:31.474484 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:38:31.474454    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:38:31.478534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:38:31.478512    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:38:31.479543 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:38:31.479529    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 17:40:25.418508 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.418473    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"]
Jul 08 17:40:25.418970 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.418752    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0258553b-7a1c-419c-a2f0-4eb1bf37605c" containerName="registry"
Jul 08 17:40:25.421739 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.421721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.424208 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424186    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 17:40:25.424635 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424617    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bssl699tgmqp9\""
Jul 08 17:40:25.424635 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424626    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 17:40:25.424785 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424625    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 17:40:25.424785 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424631    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 17:40:25.424785 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.424703    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hnc4d\""
Jul 08 17:40:25.425147 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.425132    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 17:40:25.433881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.433861    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"]
Jul 08 17:40:25.568254 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568214    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b09829-6171-438c-937b-c3938fa6a2a8-metrics-client-ca\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568254 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-grpc-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568281    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568405    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdv4\" (UniqueName: \"kubernetes.io/projected/56b09829-6171-438c-937b-c3938fa6a2a8-kube-api-access-7wdv4\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.568534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.568461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673448 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673331    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdv4\" (UniqueName: \"kubernetes.io/projected/56b09829-6171-438c-937b-c3938fa6a2a8-kube-api-access-7wdv4\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673448 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673448 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b09829-6171-438c-937b-c3938fa6a2a8-metrics-client-ca\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673476    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-grpc-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673503    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.673730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.674184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.673764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.674588 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.674310    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56b09829-6171-438c-937b-c3938fa6a2a8-metrics-client-ca\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.676468 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.676401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.676468 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.676457    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.676598 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.676504    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.676598 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.676566    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.676823 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.676800    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.677333 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.677315    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56b09829-6171-438c-937b-c3938fa6a2a8-secret-grpc-tls\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.681244 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.681222    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdv4\" (UniqueName: \"kubernetes.io/projected/56b09829-6171-438c-937b-c3938fa6a2a8-kube-api-access-7wdv4\") pod \"thanos-querier-6d77fc58c7-kcr9v\" (UID: \"56b09829-6171-438c-937b-c3938fa6a2a8\") " pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.730224 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.730190    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:25.862932 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.862913    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"]
Jul 08 17:40:25.865139 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:40:25.865108    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b09829_6171_438c_937b_c3938fa6a2a8.slice/crio-547bbd268aeebc9434e60614b359d35d8edfe0dccc5d663d8792b9091c4b6924 WatchSource:0}: Error finding container 547bbd268aeebc9434e60614b359d35d8edfe0dccc5d663d8792b9091c4b6924: Status 404 returned error can't find the container with id 547bbd268aeebc9434e60614b359d35d8edfe0dccc5d663d8792b9091c4b6924
Jul 08 17:40:25.867083 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:25.867065    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:40:26.063553 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:26.063473    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"547bbd268aeebc9434e60614b359d35d8edfe0dccc5d663d8792b9091c4b6924"}
Jul 08 17:40:28.072327 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:28.072289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"74824f0c21c33439cc2be638f0bc1cd39f18cd0654a3b50b916f72338afe16ac"}
Jul 08 17:40:28.072751 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:28.072377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"337d7673d19a383982f1c1f0a960070c876970a928b834a9a2fc645926a11b0d"}
Jul 08 17:40:28.072751 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:28.072444    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"07c73e64af2474bb17e2850b25cfc461db730a8aea2f4b5b034f967cb2141103"}
Jul 08 17:40:29.078907 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:29.078872    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"c57cd1d1c12b22aa82ea1ad1fda4aa8abf4527c83befb230936358a945faf68f"}
Jul 08 17:40:29.079307 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:29.078937    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"1e109e2afadc7629d156abcec1f43a8a8e5fbc41df8d1c159bbee1e2b5dcef3d"}
Jul 08 17:40:29.079307 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:29.078962    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" event={"ID":"56b09829-6171-438c-937b-c3938fa6a2a8","Type":"ContainerStarted","Data":"f1bb32aec04596bbb4b9341a4b863b40dbcaefcee767499e77fb0da241316fad"}
Jul 08 17:40:29.079307 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:29.079037    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:40:29.111135 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:29.111079    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v" podStartSLOduration=1.652166576 podStartE2EDuration="4.111063517s" totalImagesPullingTime="2.458896941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:40:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:40:29.110139929 +0000 UTC m=+417.976669971" watchObservedRunningTime="2026-07-08 17:40:29.111063517 +0000 UTC m=+417.977593626"
Jul 08 17:40:35.092963 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:40:35.092937    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d77fc58c7-kcr9v"
Jul 08 17:41:53.087826 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.087775    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:41:53.091185 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.091161    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.102580 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.102556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:41:53.222345 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222305    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222545 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222355    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222545 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bvpk\" (UniqueName: \"kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222545 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222461    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222545 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222545 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222510    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.222731 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.222580    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323151    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323453 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bvpk\" (UniqueName: \"kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323453 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323244    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323453 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323453 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.323453 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.323317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.324094 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.324065    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.324200 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.324091    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.324200 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.324082    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.324317 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.324250    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.325756 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.325734    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.325845 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.325825    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.331991 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.331970    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bvpk\" (UniqueName: \"kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk\") pod \"console-59cf5c85b5-p598j\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") " pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.400074 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.400029    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:41:53.533793 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:53.533719    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:41:53.535998 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:41:53.535971    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e8d74a3_95b7_434f_a0d3_470e7fa66240.slice/crio-fd8c681c1e42167640aadc3d155a1f440aed43d15a59c15f0c2cb6f890225731 WatchSource:0}: Error finding container fd8c681c1e42167640aadc3d155a1f440aed43d15a59c15f0c2cb6f890225731: Status 404 returned error can't find the container with id fd8c681c1e42167640aadc3d155a1f440aed43d15a59c15f0c2cb6f890225731
Jul 08 17:41:54.368794 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:54.368759    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5c85b5-p598j" event={"ID":"3e8d74a3-95b7-434f-a0d3-470e7fa66240","Type":"ContainerStarted","Data":"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"}
Jul 08 17:41:54.369167 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:54.368807    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5c85b5-p598j" event={"ID":"3e8d74a3-95b7-434f-a0d3-470e7fa66240","Type":"ContainerStarted","Data":"fd8c681c1e42167640aadc3d155a1f440aed43d15a59c15f0c2cb6f890225731"}
Jul 08 17:41:54.389435 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:41:54.389377    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59cf5c85b5-p598j" podStartSLOduration=1.389363127 podStartE2EDuration="1.389363127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:41:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:41:54.387554166 +0000 UTC m=+503.254084236" watchObservedRunningTime="2026-07-08 17:41:54.389363127 +0000 UTC m=+503.255893168"
Jul 08 17:42:03.400391 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:03.400355    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:42:03.400894 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:03.400811    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:42:03.405504 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:03.405483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:42:04.409946 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:04.409913    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:42:04.470534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:04.470503    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:42:29.490848 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.490765    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-d97b8566d-nq9k6" podUID="755c2b7c-42dd-40ba-8d1c-f057708512ce" containerName="console" containerID="cri-o://8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32" gracePeriod=15
Jul 08 17:42:29.730113 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.730089    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:42:29.770871 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770803    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.770871 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770868    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771053 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770901    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxhnw\" (UniqueName: \"kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771053 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770922    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771053 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770940    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771053 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.770957    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771263 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle\") pod \"755c2b7c-42dd-40ba-8d1c-f057708512ce\" (UID: \"755c2b7c-42dd-40ba-8d1c-f057708512ce\") "
Jul 08 17:42:29.771263 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771229    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config" (OuterVolumeSpecName: "console-config") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:42:29.771372 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771342    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca" (OuterVolumeSpecName: "service-ca") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:42:29.771372 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771352    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:42:29.771568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771546    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.771646 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771571    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.771646 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.771572    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:42:29.773202 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.773179    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:42:29.773507 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.773489    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:42:29.773574 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.773526    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw" (OuterVolumeSpecName: "kube-api-access-vxhnw") pod "755c2b7c-42dd-40ba-8d1c-f057708512ce" (UID: "755c2b7c-42dd-40ba-8d1c-f057708512ce"). InnerVolumeSpecName "kube-api-access-vxhnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:42:29.872324 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.872288    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxhnw\" (UniqueName: \"kubernetes.io/projected/755c2b7c-42dd-40ba-8d1c-f057708512ce-kube-api-access-vxhnw\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.872324 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.872318    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.872324 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.872331    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.872573 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.872342    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/755c2b7c-42dd-40ba-8d1c-f057708512ce-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:29.872573 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:29.872354    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/755c2b7c-42dd-40ba-8d1c-f057708512ce-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:42:30.495179 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.495140    2575 generic.go:356] "Generic (PLEG): container finished" podID="755c2b7c-42dd-40ba-8d1c-f057708512ce" containerID="8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32" exitCode=0
Jul 08 17:42:30.495656 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.495201    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d97b8566d-nq9k6"
Jul 08 17:42:30.495656 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.495227    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97b8566d-nq9k6" event={"ID":"755c2b7c-42dd-40ba-8d1c-f057708512ce","Type":"ContainerDied","Data":"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"}
Jul 08 17:42:30.495656 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.495294    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d97b8566d-nq9k6" event={"ID":"755c2b7c-42dd-40ba-8d1c-f057708512ce","Type":"ContainerDied","Data":"e02807e656b21dbdac39e3c4364ff6a39a7d5344ac1e85fc41d4cbe4e0f2d097"}
Jul 08 17:42:30.495656 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.495326    2575 scope.go:117] "RemoveContainer" containerID="8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"
Jul 08 17:42:30.503646 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.503629    2575 scope.go:117] "RemoveContainer" containerID="8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"
Jul 08 17:42:30.503942 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:42:30.503923    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32\": container with ID starting with 8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32 not found: ID does not exist" containerID="8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"
Jul 08 17:42:30.504001 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.503949    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32"} err="failed to get container status \"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32\": rpc error: code = NotFound desc = could not find container \"8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32\": container with ID starting with 8a54debc9cbd9abee2786b8e682f5ac0f5662a59cac64d4d86b87dba81097f32 not found: ID does not exist"
Jul 08 17:42:30.517501 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.517477    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:42:30.523867 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:30.523846    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d97b8566d-nq9k6"]
Jul 08 17:42:31.604558 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:42:31.602767    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755c2b7c-42dd-40ba-8d1c-f057708512ce" path="/var/lib/kubelet/pods/755c2b7c-42dd-40ba-8d1c-f057708512ce/volumes"
Jul 08 17:43:02.600650 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.600617    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"]
Jul 08 17:43:02.601184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.600868    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755c2b7c-42dd-40ba-8d1c-f057708512ce" containerName="console"
Jul 08 17:43:02.601184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.600879    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="755c2b7c-42dd-40ba-8d1c-f057708512ce" containerName="console"
Jul 08 17:43:02.601184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.600921    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="755c2b7c-42dd-40ba-8d1c-f057708512ce" containerName="console"
Jul 08 17:43:02.603829 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.603810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.606283 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.606260    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 17:43:02.607246 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.607220    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hh8m\""
Jul 08 17:43:02.607353 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.607257    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 17:43:02.612570 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.612546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"]
Jul 08 17:43:02.714398 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.714362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.714398 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.714396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.714634 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.714460    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4slw\" (UniqueName: \"kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.815654 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.815612    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.815654 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.815655    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.815907 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.815690    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4slw\" (UniqueName: \"kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.816037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.816014    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.816093 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.816035    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.830636 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.830605    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4slw\" (UniqueName: \"kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:02.913739 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:02.913711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:03.041162 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:03.041127    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"]
Jul 08 17:43:03.044451 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:43:03.044409    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13ba7d39_0e53_4140_a5a6_59c2970aaa24.slice/crio-bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400 WatchSource:0}: Error finding container bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400: Status 404 returned error can't find the container with id bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400
Jul 08 17:43:03.616977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:03.616940    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn" event={"ID":"13ba7d39-0e53-4140-a5a6-59c2970aaa24","Type":"ContainerStarted","Data":"bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400"}
Jul 08 17:43:10.642587 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:10.642548    2575 generic.go:356] "Generic (PLEG): container finished" podID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerID="7d99854bb83c5891c947ffab97a20c7fa39c5c0c0329a37bda01933edd82a409" exitCode=0
Jul 08 17:43:10.642968 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:10.642614    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn" event={"ID":"13ba7d39-0e53-4140-a5a6-59c2970aaa24","Type":"ContainerDied","Data":"7d99854bb83c5891c947ffab97a20c7fa39c5c0c0329a37bda01933edd82a409"}
Jul 08 17:43:13.654158 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:13.654124    2575 generic.go:356] "Generic (PLEG): container finished" podID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerID="987e547222f7dbf36e81ce59b8d6857ea2cb66ca2c07d6d85d5099ee34616899" exitCode=0
Jul 08 17:43:13.654641 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:13.654176    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn" event={"ID":"13ba7d39-0e53-4140-a5a6-59c2970aaa24","Type":"ContainerDied","Data":"987e547222f7dbf36e81ce59b8d6857ea2cb66ca2c07d6d85d5099ee34616899"}
Jul 08 17:43:21.685896 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:21.685861    2575 generic.go:356] "Generic (PLEG): container finished" podID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerID="0b76e240203817193f231a2adf20b35ca106d5c01bc3d6cc2491ed7f3e31df27" exitCode=0
Jul 08 17:43:21.686285 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:21.685926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn" event={"ID":"13ba7d39-0e53-4140-a5a6-59c2970aaa24","Type":"ContainerDied","Data":"0b76e240203817193f231a2adf20b35ca106d5c01bc3d6cc2491ed7f3e31df27"}
Jul 08 17:43:22.859212 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.859168    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:22.976830 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.976742    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle\") pod \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") "
Jul 08 17:43:22.976830 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.976805    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4slw\" (UniqueName: \"kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw\") pod \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") "
Jul 08 17:43:22.976830 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.976826    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util\") pod \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\" (UID: \"13ba7d39-0e53-4140-a5a6-59c2970aaa24\") "
Jul 08 17:43:22.977564 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.977523    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle" (OuterVolumeSpecName: "bundle") pod "13ba7d39-0e53-4140-a5a6-59c2970aaa24" (UID: "13ba7d39-0e53-4140-a5a6-59c2970aaa24"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:43:22.979066 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.979038    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw" (OuterVolumeSpecName: "kube-api-access-b4slw") pod "13ba7d39-0e53-4140-a5a6-59c2970aaa24" (UID: "13ba7d39-0e53-4140-a5a6-59c2970aaa24"). InnerVolumeSpecName "kube-api-access-b4slw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:43:22.984017 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:22.983987    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util" (OuterVolumeSpecName: "util") pod "13ba7d39-0e53-4140-a5a6-59c2970aaa24" (UID: "13ba7d39-0e53-4140-a5a6-59c2970aaa24"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:43:23.077600 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.077562    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:43:23.077600 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.077594    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4slw\" (UniqueName: \"kubernetes.io/projected/13ba7d39-0e53-4140-a5a6-59c2970aaa24-kube-api-access-b4slw\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:43:23.077600 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.077605    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/13ba7d39-0e53-4140-a5a6-59c2970aaa24-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:43:23.696996 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.696965    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn" event={"ID":"13ba7d39-0e53-4140-a5a6-59c2970aaa24","Type":"ContainerDied","Data":"bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400"}
Jul 08 17:43:23.697152 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.697015    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb0703c69bf0566ec669a2e815efa710e0ad0e0a06b07303956a1ca9118e1400"
Jul 08 17:43:23.697152 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:23.696978    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540s7nkn"
Jul 08 17:43:31.498316 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:31.498291    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:43:31.498901 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:31.498346    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:43:44.490309 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490268    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llvl4"]
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490645    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="pull"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490663    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="pull"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490677    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="util"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490685    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="util"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490702    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="extract"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490710    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="extract"
Jul 08 17:43:44.490913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.490770    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="13ba7d39-0e53-4140-a5a6-59c2970aaa24" containerName="extract"
Jul 08 17:43:44.493723 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.493701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.507575 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.507556    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 08 17:43:44.508573 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.508556    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-5sswl\""
Jul 08 17:43:44.508639 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.508626    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 08 17:43:44.520936 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.520909    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llvl4"]
Jul 08 17:43:44.531821 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.531798    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcv9\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-kube-api-access-5gcv9\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.531929 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.531829    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.632674 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.632635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.632868 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.632734    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcv9\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-kube-api-access-5gcv9\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.645794 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.645768    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-bound-sa-token\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.645910 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.645872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcv9\" (UniqueName: \"kubernetes.io/projected/0123c22e-4e55-4cac-8cb7-d852857c36ae-kube-api-access-5gcv9\") pod \"cert-manager-55b4d954d5-llvl4\" (UID: \"0123c22e-4e55-4cac-8cb7-d852857c36ae\") " pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.802781 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.802700    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-llvl4"
Jul 08 17:43:44.930074 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:44.930030    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-llvl4"]
Jul 08 17:43:44.932929 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:43:44.932899    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0123c22e_4e55_4cac_8cb7_d852857c36ae.slice/crio-299a1c9ab2deb94e37ff09d18a415daf3513d4c13b4763a149d978a3fd2179c9 WatchSource:0}: Error finding container 299a1c9ab2deb94e37ff09d18a415daf3513d4c13b4763a149d978a3fd2179c9: Status 404 returned error can't find the container with id 299a1c9ab2deb94e37ff09d18a415daf3513d4c13b4763a149d978a3fd2179c9
Jul 08 17:43:45.775639 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:45.775598    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-llvl4" event={"ID":"0123c22e-4e55-4cac-8cb7-d852857c36ae","Type":"ContainerStarted","Data":"299a1c9ab2deb94e37ff09d18a415daf3513d4c13b4763a149d978a3fd2179c9"}
Jul 08 17:43:47.784943 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:47.784906    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-llvl4" event={"ID":"0123c22e-4e55-4cac-8cb7-d852857c36ae","Type":"ContainerStarted","Data":"3abb9be15328d8459e881c19648e2cb40513e328c1232e2dde8e69974e270640"}
Jul 08 17:43:47.820213 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:43:47.820156    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-llvl4" podStartSLOduration=1.064381663 podStartE2EDuration="3.82013947s" totalImagesPullingTime="2.755757807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:47.819452972 +0000 UTC m=+616.685983008" watchObservedRunningTime="2026-07-08 17:43:47.82013947 +0000 UTC m=+616.686669513"
Jul 08 17:44:08.391090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.391007    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"]
Jul 08 17:44:08.394248 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.394231    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.398248 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.398224    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 08 17:44:08.398690 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.398674    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 08 17:44:08.407913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.407891    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hh8m\""
Jul 08 17:44:08.408751 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.408722    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"]
Jul 08 17:44:08.493768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.493729    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.493768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.493769    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.493970 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.493787    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmbws\" (UniqueName: \"kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.594609 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.594577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.594681 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.594616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.594681 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.594635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmbws\" (UniqueName: \"kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.594965 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.594945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.595020 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.595002    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.604903 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.604865    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmbws\" (UniqueName: \"kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.702622 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.702542    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:08.838563 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:08.838525    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393e48c4_1ec3_47d1_a604_11fa404a45a0.slice/crio-2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467 WatchSource:0}: Error finding container 2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467: Status 404 returned error can't find the container with id 2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467
Jul 08 17:44:08.850395 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.850366    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"]
Jul 08 17:44:08.858285 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:08.858249    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn" event={"ID":"393e48c4-1ec3-47d1-a604-11fa404a45a0","Type":"ContainerStarted","Data":"2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467"}
Jul 08 17:44:09.863534 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:09.863501    2575 generic.go:356] "Generic (PLEG): container finished" podID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerID="3a006aeaa0ef38f3f5bd1d382b9173f81d31b6de7b8d1de9363392ee0ced5795" exitCode=0
Jul 08 17:44:09.863894 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:09.863588    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn" event={"ID":"393e48c4-1ec3-47d1-a604-11fa404a45a0","Type":"ContainerDied","Data":"3a006aeaa0ef38f3f5bd1d382b9173f81d31b6de7b8d1de9363392ee0ced5795"}
Jul 08 17:44:10.868267 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:10.868237    2575 generic.go:356] "Generic (PLEG): container finished" podID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerID="f25f9f79e79f330644cdbf39dd7cdac02309991abbfa9f2831a2c57b4d0246d4" exitCode=0
Jul 08 17:44:10.868730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:10.868308    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn" event={"ID":"393e48c4-1ec3-47d1-a604-11fa404a45a0","Type":"ContainerDied","Data":"f25f9f79e79f330644cdbf39dd7cdac02309991abbfa9f2831a2c57b4d0246d4"}
Jul 08 17:44:11.878759 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:11.878722    2575 generic.go:356] "Generic (PLEG): container finished" podID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerID="68858eee9dddf194046518b6c92460a80d8c2af215d38661274b92a9a255d89d" exitCode=0
Jul 08 17:44:11.879250 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:11.878774    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn" event={"ID":"393e48c4-1ec3-47d1-a604-11fa404a45a0","Type":"ContainerDied","Data":"68858eee9dddf194046518b6c92460a80d8c2af215d38661274b92a9a255d89d"}
Jul 08 17:44:13.012661 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.012633    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:13.130634 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.130598    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util\") pod \"393e48c4-1ec3-47d1-a604-11fa404a45a0\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") "
Jul 08 17:44:13.130827 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.130646    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmbws\" (UniqueName: \"kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws\") pod \"393e48c4-1ec3-47d1-a604-11fa404a45a0\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") "
Jul 08 17:44:13.130827 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.130703    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle\") pod \"393e48c4-1ec3-47d1-a604-11fa404a45a0\" (UID: \"393e48c4-1ec3-47d1-a604-11fa404a45a0\") "
Jul 08 17:44:13.131393 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.131364    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle" (OuterVolumeSpecName: "bundle") pod "393e48c4-1ec3-47d1-a604-11fa404a45a0" (UID: "393e48c4-1ec3-47d1-a604-11fa404a45a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:44:13.132822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.132798    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws" (OuterVolumeSpecName: "kube-api-access-gmbws") pod "393e48c4-1ec3-47d1-a604-11fa404a45a0" (UID: "393e48c4-1ec3-47d1-a604-11fa404a45a0"). InnerVolumeSpecName "kube-api-access-gmbws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:44:13.135907 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.135848    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util" (OuterVolumeSpecName: "util") pod "393e48c4-1ec3-47d1-a604-11fa404a45a0" (UID: "393e48c4-1ec3-47d1-a604-11fa404a45a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 17:44:13.231378 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.231335    2575 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:44:13.231378 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.231373    2575 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/393e48c4-1ec3-47d1-a604-11fa404a45a0-util\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:44:13.231378 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.231386    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmbws\" (UniqueName: \"kubernetes.io/projected/393e48c4-1ec3-47d1-a604-11fa404a45a0-kube-api-access-gmbws\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:44:13.888190 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.888161    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn"
Jul 08 17:44:13.888358 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.888190    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff6qcn" event={"ID":"393e48c4-1ec3-47d1-a604-11fa404a45a0","Type":"ContainerDied","Data":"2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467"}
Jul 08 17:44:13.888358 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:13.888238    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b193c9ff9eb4d9df5beb85055b0d560db0c30cf8553d6582391196100f7f467"
Jul 08 17:44:23.992934 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.992898    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"]
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993167    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="util"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993185    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="util"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993212    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="pull"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993221    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="pull"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993240    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="extract"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993249    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="extract"
Jul 08 17:44:23.995111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.993307    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="393e48c4-1ec3-47d1-a604-11fa404a45a0" containerName="extract"
Jul 08 17:44:23.995679 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:23.995663    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.000109 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.000088    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 17:44:24.000316 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.000297    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 17:44:24.000543 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.000525    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 17:44:24.000618 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.000600    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 17:44:24.001107 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.001091    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-98zkq\""
Jul 08 17:44:24.012154 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.012124    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"]
Jul 08 17:44:24.112106 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.112069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.112287 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.112116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.112287 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.112149    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmzpz\" (UniqueName: \"kubernetes.io/projected/a73b4be0-7617-4acc-becb-6610a33df643-kube-api-access-qmzpz\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.112287 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.112178    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.112287 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.112196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.213548 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213509    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.213548 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.213818 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmzpz\" (UniqueName: \"kubernetes.io/projected/a73b4be0-7617-4acc-becb-6610a33df643-kube-api-access-qmzpz\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.213818 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.213818 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.214017 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.213993    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.215969 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.215947    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a73b4be0-7617-4acc-becb-6610a33df643-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.216072 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.216059    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.216130 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.216098    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a73b4be0-7617-4acc-becb-6610a33df643-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.225703 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.225670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmzpz\" (UniqueName: \"kubernetes.io/projected/a73b4be0-7617-4acc-becb-6610a33df643-kube-api-access-qmzpz\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-lwvfv\" (UID: \"a73b4be0-7617-4acc-becb-6610a33df643\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.306821 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.306721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:24.442913 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.442886    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"]
Jul 08 17:44:24.445230 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:24.445207    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73b4be0_7617_4acc_becb_6610a33df643.slice/crio-c7ac99342576f566176f58d5ad42c3a39d0fe2d39f2bab87cec51acc296da973 WatchSource:0}: Error finding container c7ac99342576f566176f58d5ad42c3a39d0fe2d39f2bab87cec51acc296da973: Status 404 returned error can't find the container with id c7ac99342576f566176f58d5ad42c3a39d0fe2d39f2bab87cec51acc296da973
Jul 08 17:44:24.927036 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:24.927001    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv" event={"ID":"a73b4be0-7617-4acc-becb-6610a33df643","Type":"ContainerStarted","Data":"c7ac99342576f566176f58d5ad42c3a39d0fe2d39f2bab87cec51acc296da973"}
Jul 08 17:44:27.940366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:27.940325    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv" event={"ID":"a73b4be0-7617-4acc-becb-6610a33df643","Type":"ContainerStarted","Data":"63319a8ebcff40d894afd8075e4212ef4e354e86a47eb3e75d5d2c521216bb8e"}
Jul 08 17:44:28.945956 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:28.945915    2575 generic.go:356] "Generic (PLEG): container finished" podID="a73b4be0-7617-4acc-becb-6610a33df643" containerID="63319a8ebcff40d894afd8075e4212ef4e354e86a47eb3e75d5d2c521216bb8e" exitCode=0
Jul 08 17:44:28.946388 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:28.945950    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv" event={"ID":"a73b4be0-7617-4acc-becb-6610a33df643","Type":"ContainerDied","Data":"63319a8ebcff40d894afd8075e4212ef4e354e86a47eb3e75d5d2c521216bb8e"}
Jul 08 17:44:29.951565 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:29.951530    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv" event={"ID":"a73b4be0-7617-4acc-becb-6610a33df643","Type":"ContainerStarted","Data":"5762f7ba151d4e941f8d297872f2a11770474f317aaa38793d31d087c34adba7"}
Jul 08 17:44:29.952003 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:29.951670    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:29.979735 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:29.979680    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv" podStartSLOduration=2.649961083 podStartE2EDuration="6.979662905s" totalImagesPullingTime="3.313019087s" totalInitContainerRuntime="1.016682735s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:29.977337403 +0000 UTC m=+658.843867472" watchObservedRunningTime="2026-07-08 17:44:29.979662905 +0000 UTC m=+658.846192948"
Jul 08 17:44:40.957816 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:40.957788    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-lwvfv"
Jul 08 17:44:44.005190 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.005156    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bpg98"]
Jul 08 17:44:44.013459 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.013435    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.016166 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.016139    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vrdcs\""
Jul 08 17:44:44.016407 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.016386    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 08 17:44:44.019271 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.019242    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bpg98"]
Jul 08 17:44:44.187621 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.187585    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10635e3c-f49f-4592-b7e7-d6d6c284db9c-cert\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.187801 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.187655    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzngn\" (UniqueName: \"kubernetes.io/projected/10635e3c-f49f-4592-b7e7-d6d6c284db9c-kube-api-access-rzngn\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.288285 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.288193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzngn\" (UniqueName: \"kubernetes.io/projected/10635e3c-f49f-4592-b7e7-d6d6c284db9c-kube-api-access-rzngn\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.288285 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.288251    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10635e3c-f49f-4592-b7e7-d6d6c284db9c-cert\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.290585 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.290555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/10635e3c-f49f-4592-b7e7-d6d6c284db9c-cert\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.300054 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.300035    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzngn\" (UniqueName: \"kubernetes.io/projected/10635e3c-f49f-4592-b7e7-d6d6c284db9c-kube-api-access-rzngn\") pod \"odh-model-controller-7998c67dc4-bpg98\" (UID: \"10635e3c-f49f-4592-b7e7-d6d6c284db9c\") " pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.326349 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.326323    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:44.458870 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.458837    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bpg98"]
Jul 08 17:44:44.462629 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:44.462603    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10635e3c_f49f_4592_b7e7_d6d6c284db9c.slice/crio-4e59f6b507dd64fd9b15d451ac6d5f5ac12f0fad6dd57549de69a164ee13c906 WatchSource:0}: Error finding container 4e59f6b507dd64fd9b15d451ac6d5f5ac12f0fad6dd57549de69a164ee13c906: Status 404 returned error can't find the container with id 4e59f6b507dd64fd9b15d451ac6d5f5ac12f0fad6dd57549de69a164ee13c906
Jul 08 17:44:44.610817 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.610740    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ghnqr"]
Jul 08 17:44:44.614940 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.614924    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.617723 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.617698    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 08 17:44:44.617826 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.617702    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-rm7jz\""
Jul 08 17:44:44.624237 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.624213    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ghnqr"]
Jul 08 17:44:44.792832 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.792800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b7dfd8-091f-48bf-8749-a41366449680-tls-certs\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.793002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.792845    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6szm\" (UniqueName: \"kubernetes.io/projected/59b7dfd8-091f-48bf-8749-a41366449680-kube-api-access-b6szm\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.893612 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.893519    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b7dfd8-091f-48bf-8749-a41366449680-tls-certs\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.893612 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.893583    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6szm\" (UniqueName: \"kubernetes.io/projected/59b7dfd8-091f-48bf-8749-a41366449680-kube-api-access-b6szm\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.895892 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.895865    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59b7dfd8-091f-48bf-8749-a41366449680-tls-certs\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.912058 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.912034    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6szm\" (UniqueName: \"kubernetes.io/projected/59b7dfd8-091f-48bf-8749-a41366449680-kube-api-access-b6szm\") pod \"model-serving-api-54d89bd5fc-ghnqr\" (UID: \"59b7dfd8-091f-48bf-8749-a41366449680\") " pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:44.926522 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:44.926500    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:45.009686 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:45.009653    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98" event={"ID":"10635e3c-f49f-4592-b7e7-d6d6c284db9c","Type":"ContainerStarted","Data":"4e59f6b507dd64fd9b15d451ac6d5f5ac12f0fad6dd57549de69a164ee13c906"}
Jul 08 17:44:45.058020 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:45.057992    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ghnqr"]
Jul 08 17:44:45.060127 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:45.060097    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b7dfd8_091f_48bf_8749_a41366449680.slice/crio-1a5f780803dce618e9bde634a37c7cc3333154c61213109032e2d677c81bdb41 WatchSource:0}: Error finding container 1a5f780803dce618e9bde634a37c7cc3333154c61213109032e2d677c81bdb41: Status 404 returned error can't find the container with id 1a5f780803dce618e9bde634a37c7cc3333154c61213109032e2d677c81bdb41
Jul 08 17:44:46.015371 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:46.015328    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr" event={"ID":"59b7dfd8-091f-48bf-8749-a41366449680","Type":"ContainerStarted","Data":"1a5f780803dce618e9bde634a37c7cc3333154c61213109032e2d677c81bdb41"}
Jul 08 17:44:48.025571 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.025481    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr" event={"ID":"59b7dfd8-091f-48bf-8749-a41366449680","Type":"ContainerStarted","Data":"3bf6eaebc546e88be619ea7b92047a9711b4caa884c1132ebfe5168ee261ab1e"}
Jul 08 17:44:48.025984 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.025574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:48.026970 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.026951    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98" event={"ID":"10635e3c-f49f-4592-b7e7-d6d6c284db9c","Type":"ContainerStarted","Data":"4e59794d16a90f44310a5b3198845e3da5435db131c6436810c95481d55ef451"}
Jul 08 17:44:48.027083 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.027070    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:48.050109 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.050033    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr" podStartSLOduration=1.475504793 podStartE2EDuration="4.050014227s" totalImagesPullingTime="2.574509434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:48.04817222 +0000 UTC m=+676.914702324" watchObservedRunningTime="2026-07-08 17:44:48.050014227 +0000 UTC m=+676.916544270"
Jul 08 17:44:48.067134 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:48.067084    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98" podStartSLOduration=1.888451156 podStartE2EDuration="5.067069082s" totalImagesPullingTime="3.178617926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:48.065784461 +0000 UTC m=+676.932314503" watchObservedRunningTime="2026-07-08 17:44:48.067069082 +0000 UTC m=+676.933599125"
Jul 08 17:44:53.893955 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.893921    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"]
Jul 08 17:44:53.896878 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.896858    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:53.899465 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.899442    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 08 17:44:53.899704 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.899670    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-snqx2\""
Jul 08 17:44:53.910660 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.910632    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"]
Jul 08 17:44:53.921986 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.921959    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"]
Jul 08 17:44:53.925150 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.925130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:53.927809 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.927791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 08 17:44:53.927901 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.927791    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k6wk2\""
Jul 08 17:44:53.936749 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.936729    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"]
Jul 08 17:44:53.965914 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.965878    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:53.966090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.965928    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs56s\" (UniqueName: \"kubernetes.io/projected/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-kube-api-access-bs56s\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:53.966090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.965968    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:53.966090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:53.965985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdhj\" (UniqueName: \"kubernetes.io/projected/4f3c477d-350e-4fac-9fb6-103f60850493-kube-api-access-ksdhj\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.067100 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.067067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:54.067294 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.067111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs56s\" (UniqueName: \"kubernetes.io/projected/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-kube-api-access-bs56s\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:54.067294 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.067134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.067294 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.067150    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdhj\" (UniqueName: \"kubernetes.io/projected/4f3c477d-350e-4fac-9fb6-103f60850493-kube-api-access-ksdhj\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.067294 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:54.067236    2575 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 08 17:44:54.067559 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:54.067307    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert podName:4f3c477d-350e-4fac-9fb6-103f60850493 nodeName:}" failed. No retries permitted until 2026-07-08 17:44:54.56728623 +0000 UTC m=+683.433816265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert") pod "kserve-controller-manager-d6f4b65b8-dfppr" (UID: "4f3c477d-350e-4fac-9fb6-103f60850493") : secret "kserve-webhook-server-cert" not found
Jul 08 17:44:54.069761 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.069735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:54.081678 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.081652    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdhj\" (UniqueName: \"kubernetes.io/projected/4f3c477d-350e-4fac-9fb6-103f60850493-kube-api-access-ksdhj\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.092842 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.092820    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs56s\" (UniqueName: \"kubernetes.io/projected/66e4fd13-6f84-4ba1-8446-1d8fe19e9b56-kube-api-access-bs56s\") pod \"llmisvc-controller-manager-777c6bd7d5-zwtv8\" (UID: \"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:54.235002 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.234915    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:54.383532 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.383501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"]
Jul 08 17:44:54.386503 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:54.386468    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod66e4fd13_6f84_4ba1_8446_1d8fe19e9b56.slice/crio-784381fbde387a7788cc26de0d0a8240aa3dc70fa4d4031d25cd05e075bb45e3 WatchSource:0}: Error finding container 784381fbde387a7788cc26de0d0a8240aa3dc70fa4d4031d25cd05e075bb45e3: Status 404 returned error can't find the container with id 784381fbde387a7788cc26de0d0a8240aa3dc70fa4d4031d25cd05e075bb45e3
Jul 08 17:44:54.449569 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.449535    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"]
Jul 08 17:44:54.453932 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.453911    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.456520 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.456492    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 17:44:54.456641 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.456607    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 17:44:54.456641 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.456624    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wmh7c\""
Jul 08 17:44:54.456769 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.456644    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 17:44:54.456911 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.456894    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 17:44:54.464466 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.464444    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"]
Jul 08 17:44:54.469862 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.469842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294e26c4-36d0-4825-874b-7e853656fede-tmp\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.469962 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.469920    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.470017 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.469980    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tpnt\" (UniqueName: \"kubernetes.io/projected/294e26c4-36d0-4825-874b-7e853656fede-kube-api-access-4tpnt\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.570968 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.570874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.570968 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.570935    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tpnt\" (UniqueName: \"kubernetes.io/projected/294e26c4-36d0-4825-874b-7e853656fede-kube-api-access-4tpnt\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.571211 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.570983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294e26c4-36d0-4825-874b-7e853656fede-tmp\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.571211 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.571023    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.571211 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:54.571024    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 17:44:54.571211 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:54.571112    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs podName:294e26c4-36d0-4825-874b-7e853656fede nodeName:}" failed. No retries permitted until 2026-07-08 17:44:55.071092812 +0000 UTC m=+683.937622847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs") pod "kube-auth-proxy-6579f5c748-tgsjr" (UID: "294e26c4-36d0-4825-874b-7e853656fede") : secret "kube-auth-proxy-tls" not found
Jul 08 17:44:54.573704 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.573684    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/294e26c4-36d0-4825-874b-7e853656fede-tmp\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.573800 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.573783    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f3c477d-350e-4fac-9fb6-103f60850493-cert\") pod \"kserve-controller-manager-d6f4b65b8-dfppr\" (UID: \"4f3c477d-350e-4fac-9fb6-103f60850493\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.579811 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.579786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tpnt\" (UniqueName: \"kubernetes.io/projected/294e26c4-36d0-4825-874b-7e853656fede-kube-api-access-4tpnt\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:54.807281 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.807247    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:54.935574 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:54.935546    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"]
Jul 08 17:44:54.938342 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:54.938319    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3c477d_350e_4fac_9fb6_103f60850493.slice/crio-8f54e7c357f503eb24670108c2109e6c6e1f0476b49f2c58b62d2531b3cfd9ac WatchSource:0}: Error finding container 8f54e7c357f503eb24670108c2109e6c6e1f0476b49f2c58b62d2531b3cfd9ac: Status 404 returned error can't find the container with id 8f54e7c357f503eb24670108c2109e6c6e1f0476b49f2c58b62d2531b3cfd9ac
Jul 08 17:44:55.056041 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:55.055998    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8" event={"ID":"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56","Type":"ContainerStarted","Data":"784381fbde387a7788cc26de0d0a8240aa3dc70fa4d4031d25cd05e075bb45e3"}
Jul 08 17:44:55.057149 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:55.057125    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr" event={"ID":"4f3c477d-350e-4fac-9fb6-103f60850493","Type":"ContainerStarted","Data":"8f54e7c357f503eb24670108c2109e6c6e1f0476b49f2c58b62d2531b3cfd9ac"}
Jul 08 17:44:55.073627 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:55.073602    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:55.073732 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:55.073718    2575 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 08 17:44:55.073781 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:44:55.073772    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs podName:294e26c4-36d0-4825-874b-7e853656fede nodeName:}" failed. No retries permitted until 2026-07-08 17:44:56.073757666 +0000 UTC m=+684.940287686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs") pod "kube-auth-proxy-6579f5c748-tgsjr" (UID: "294e26c4-36d0-4825-874b-7e853656fede") : secret "kube-auth-proxy-tls" not found
Jul 08 17:44:56.080755 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.080721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:56.083406 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.083375    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/294e26c4-36d0-4825-874b-7e853656fede-tls-certs\") pod \"kube-auth-proxy-6579f5c748-tgsjr\" (UID: \"294e26c4-36d0-4825-874b-7e853656fede\") " pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:56.263997 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.263963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"
Jul 08 17:44:56.298542 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.298513    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"]
Jul 08 17:44:56.302596 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.302572    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.311844 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.311497    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 08 17:44:56.311844 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.311827    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-9k2d2\""
Jul 08 17:44:56.312819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.312663    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 08 17:44:56.312819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.312692    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 08 17:44:56.313577 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.313462    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 08 17:44:56.332636 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.332569    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"]
Jul 08 17:44:56.385768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385537    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.385768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385579    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.385768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385645    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsg9m\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-kube-api-access-xsg9m\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.385768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385664    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.385768 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385762    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0b881-d4f4-47ec-9139-82acc02d3289-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.386156 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385830    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.386156 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.385872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.445383 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.445346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr"]
Jul 08 17:44:56.447715 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:56.447687    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294e26c4_36d0_4825_874b_7e853656fede.slice/crio-a5e97a52be4fa8be640b02d38a644995e9abeefce712043367e6f926506a676b WatchSource:0}: Error finding container a5e97a52be4fa8be640b02d38a644995e9abeefce712043367e6f926506a676b: Status 404 returned error can't find the container with id a5e97a52be4fa8be640b02d38a644995e9abeefce712043367e6f926506a676b
Jul 08 17:44:56.487364 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487322    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487364 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487789 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487443    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487789 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487502    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsg9m\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-kube-api-access-xsg9m\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487789 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487789 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0b881-d4f4-47ec-9139-82acc02d3289-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.487789 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.487608    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.488437 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.488393    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.490881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.490460    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0b881-d4f4-47ec-9139-82acc02d3289-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.490881 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.490717    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.491035 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.490945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.491372 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.491258    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.498851 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.498822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.499766 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.499719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsg9m\" (UniqueName: \"kubernetes.io/projected/efd0b881-d4f4-47ec-9139-82acc02d3289-kube-api-access-xsg9m\") pod \"istiod-openshift-gateway-94bb8fbfd-8pbkf\" (UID: \"efd0b881-d4f4-47ec-9139-82acc02d3289\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.614888 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.614852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:44:56.786293 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:56.786263    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"]
Jul 08 17:44:56.788173 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:44:56.788144    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd0b881_d4f4_47ec_9139_82acc02d3289.slice/crio-dafcb4655346fb8ad5005af24f4bcf6a47fa6d3bf77bf2c87bea219061f55000 WatchSource:0}: Error finding container dafcb4655346fb8ad5005af24f4bcf6a47fa6d3bf77bf2c87bea219061f55000: Status 404 returned error can't find the container with id dafcb4655346fb8ad5005af24f4bcf6a47fa6d3bf77bf2c87bea219061f55000
Jul 08 17:44:57.068266 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:57.068173    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf" event={"ID":"efd0b881-d4f4-47ec-9139-82acc02d3289","Type":"ContainerStarted","Data":"dafcb4655346fb8ad5005af24f4bcf6a47fa6d3bf77bf2c87bea219061f55000"}
Jul 08 17:44:57.069445 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:57.069402    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr" event={"ID":"294e26c4-36d0-4825-874b-7e853656fede","Type":"ContainerStarted","Data":"a5e97a52be4fa8be640b02d38a644995e9abeefce712043367e6f926506a676b"}
Jul 08 17:44:58.075767 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:58.075730    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr" event={"ID":"4f3c477d-350e-4fac-9fb6-103f60850493","Type":"ContainerStarted","Data":"91577d555df6bac8343958eab27cc869023942b6613f1bbec5346df13a1a1b03"}
Jul 08 17:44:58.076245 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:58.075857    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:44:58.093966 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:58.093911    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr" podStartSLOduration=2.61638341 podStartE2EDuration="5.093890689s" totalImagesPullingTime="2.477507279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:58.092614085 +0000 UTC m=+686.959144160" watchObservedRunningTime="2026-07-08 17:44:58.093890689 +0000 UTC m=+686.960420733"
Jul 08 17:44:59.035228 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:59.034614    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bpg98"
Jul 08 17:44:59.038333 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:59.038305    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ghnqr"
Jul 08 17:44:59.085183 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:59.085145    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8" event={"ID":"66e4fd13-6f84-4ba1-8446-1d8fe19e9b56","Type":"ContainerStarted","Data":"202eee6b48bd4b778a469a553eb2b5a6f8892f682e717888e1967c78042c65ca"}
Jul 08 17:44:59.085686 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:59.085239    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:44:59.110658 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:44:59.110600    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8" podStartSLOduration=2.170286543 podStartE2EDuration="6.110583962s" totalImagesPullingTime="3.940297419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:59.108866695 +0000 UTC m=+687.975396768" watchObservedRunningTime="2026-07-08 17:44:59.110583962 +0000 UTC m=+687.977114004"
Jul 08 17:45:00.526213 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:00.526177    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 17:45:00.526816 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:00.526241    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 08 17:45:01.095556 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.095514    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr" event={"ID":"294e26c4-36d0-4825-874b-7e853656fede","Type":"ContainerStarted","Data":"9d86d223b4841295e6e4edfabe2d6a406c35e98b1983110717e6faa73fa13d0b"}
Jul 08 17:45:01.097069 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.097041    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf" event={"ID":"efd0b881-d4f4-47ec-9139-82acc02d3289","Type":"ContainerStarted","Data":"de432402e2e18e1c07350d52ebdedd5b67e7b287a68cd635d3f12d0f03283230"}
Jul 08 17:45:01.097205 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.097166    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:45:01.098801 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.098777    2575 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-8pbkf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 08 17:45:01.098905 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.098819    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf" podUID="efd0b881-d4f4-47ec-9139-82acc02d3289" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 08 17:45:01.114647 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.114604    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6579f5c748-tgsjr" podStartSLOduration=3.040770084 podStartE2EDuration="7.114590627s" totalImagesPullingTime="4.073820543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:01.113527373 +0000 UTC m=+689.980057440" watchObservedRunningTime="2026-07-08 17:45:01.114590627 +0000 UTC m=+689.981120668"
Jul 08 17:45:01.161015 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:01.160972    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf" podStartSLOduration=1.42546757 podStartE2EDuration="5.160956291s" totalImagesPullingTime="3.735488721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:01.157925634 +0000 UTC m=+690.024455678" watchObservedRunningTime="2026-07-08 17:45:01.160956291 +0000 UTC m=+690.027486333"
Jul 08 17:45:02.101602 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:02.101568    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-8pbkf"
Jul 08 17:45:29.090634 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:29.090550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-dfppr"
Jul 08 17:45:30.091804 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:45:30.091773    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-zwtv8"
Jul 08 17:46:19.200741 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.200707    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"]
Jul 08 17:46:19.204039 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.204022    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:19.206623 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.206600    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 17:46:19.207569 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.207552    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 08 17:46:19.207679 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.207554    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 17:46:19.207679 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.207606    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-pnmtb\""
Jul 08 17:46:19.215532 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.215513    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"]
Jul 08 17:46:19.288167 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.288133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72snb\" (UniqueName: \"kubernetes.io/projected/97eb71fa-daf6-4cdf-b43b-d763f9b8b393-kube-api-access-72snb\") pod \"dns-operator-controller-manager-864dd78c4c-mfqxl\" (UID: \"97eb71fa-daf6-4cdf-b43b-d763f9b8b393\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:19.389010 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.388974    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72snb\" (UniqueName: \"kubernetes.io/projected/97eb71fa-daf6-4cdf-b43b-d763f9b8b393-kube-api-access-72snb\") pod \"dns-operator-controller-manager-864dd78c4c-mfqxl\" (UID: \"97eb71fa-daf6-4cdf-b43b-d763f9b8b393\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:19.401382 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.401350    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72snb\" (UniqueName: \"kubernetes.io/projected/97eb71fa-daf6-4cdf-b43b-d763f9b8b393-kube-api-access-72snb\") pod \"dns-operator-controller-manager-864dd78c4c-mfqxl\" (UID: \"97eb71fa-daf6-4cdf-b43b-d763f9b8b393\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:19.513611 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.513527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:19.648557 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.648523    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"]
Jul 08 17:46:19.651921 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:46:19.651890    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eb71fa_daf6_4cdf_b43b_d763f9b8b393.slice/crio-75ae70bdb541b6fb7803635ffea172281eee09c6c621f032e20ed4b2b282e25f WatchSource:0}: Error finding container 75ae70bdb541b6fb7803635ffea172281eee09c6c621f032e20ed4b2b282e25f: Status 404 returned error can't find the container with id 75ae70bdb541b6fb7803635ffea172281eee09c6c621f032e20ed4b2b282e25f
Jul 08 17:46:19.653780 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:19.653761    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:46:20.435770 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:20.435736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl" event={"ID":"97eb71fa-daf6-4cdf-b43b-d763f9b8b393","Type":"ContainerStarted","Data":"75ae70bdb541b6fb7803635ffea172281eee09c6c621f032e20ed4b2b282e25f"}
Jul 08 17:46:22.118854 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.118821    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"]
Jul 08 17:46:22.122627 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.122602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:22.126317 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.126285    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9wxr8\""
Jul 08 17:46:22.137339 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.137311    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"]
Jul 08 17:46:22.217082 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.217049    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdfnl\" (UniqueName: \"kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-8h74r\" (UID: \"998ba47f-4ffc-45a4-8c73-112e1617645b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:22.317982 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.317948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdfnl\" (UniqueName: \"kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-8h74r\" (UID: \"998ba47f-4ffc-45a4-8c73-112e1617645b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:22.353801 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.353765    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdfnl\" (UniqueName: \"kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl\") pod \"limitador-operator-controller-manager-859d7b78bd-8h74r\" (UID: \"998ba47f-4ffc-45a4-8c73-112e1617645b\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:22.434609 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.434527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:22.586181 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:22.586141    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"]
Jul 08 17:46:22.590247 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:46:22.590212    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998ba47f_4ffc_45a4_8c73_112e1617645b.slice/crio-28a7796f12a9a8438cef4ba4fb0c6a37c2daeaaa410aaf07f39182ffdf4b8b6e WatchSource:0}: Error finding container 28a7796f12a9a8438cef4ba4fb0c6a37c2daeaaa410aaf07f39182ffdf4b8b6e: Status 404 returned error can't find the container with id 28a7796f12a9a8438cef4ba4fb0c6a37c2daeaaa410aaf07f39182ffdf4b8b6e
Jul 08 17:46:23.451842 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:23.451804    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r" event={"ID":"998ba47f-4ffc-45a4-8c73-112e1617645b","Type":"ContainerStarted","Data":"28a7796f12a9a8438cef4ba4fb0c6a37c2daeaaa410aaf07f39182ffdf4b8b6e"}
Jul 08 17:46:23.453463 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:23.453434    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl" event={"ID":"97eb71fa-daf6-4cdf-b43b-d763f9b8b393","Type":"ContainerStarted","Data":"e5a8908e8d4eb8f1250b2847decb60138da089acf6349ba9b719af84d2c84722"}
Jul 08 17:46:23.453586 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:23.453564    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:23.478944 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:23.478892    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl" podStartSLOduration=1.681849879 podStartE2EDuration="4.478874761s" totalImagesPullingTime="2.797024882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:23.477777078 +0000 UTC m=+772.344307123" watchObservedRunningTime="2026-07-08 17:46:23.478874761 +0000 UTC m=+772.345404802"
Jul 08 17:46:25.463274 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:25.463241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r" event={"ID":"998ba47f-4ffc-45a4-8c73-112e1617645b","Type":"ContainerStarted","Data":"c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b"}
Jul 08 17:46:25.463675 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:25.463378    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:25.483445 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:25.483374    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r" podStartSLOduration=1.666697079 podStartE2EDuration="3.483357171s" totalImagesPullingTime="1.816660092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:25.480871984 +0000 UTC m=+774.347402048" watchObservedRunningTime="2026-07-08 17:46:25.483357171 +0000 UTC m=+774.349887213"
Jul 08 17:46:34.460692 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:34.460664    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-mfqxl"
Jul 08 17:46:36.469710 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.469675    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.471769 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.471739    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"]
Jul 08 17:46:36.486165 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.486133    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"]
Jul 08 17:46:36.499729 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.499684    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"]
Jul 08 17:46:36.500078 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.500061    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" containerName="manager"
Jul 08 17:46:36.500144 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.500082    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" containerName="manager"
Jul 08 17:46:36.500180 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.500155    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" containerName="manager"
Jul 08 17:46:36.500436 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:36.500365    2575 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"998ba47f-4ffc-45a4-8c73-112e1617645b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"lastTransitionTime\\\":\\\"2026-07-08T17:46:36Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"Ready\\\"},{\\\"lastTransitionTime\\\":\\\"2026-07-08T17:46:36Z\\\",\\\"message\\\":null,\\\"reason\\\":null,\\\"status\\\":\\\"True\\\",\\\"type\\\":\\\"ContainersReady\\\"}],\\\"containerStatuses\\\":[{\\\"allocatedResources\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"},\\\"containerID\\\":\\\"cri-o://c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b\\\",\\\"image\\\":\\\"quay.io/kuadrant/limitador-operator:v0.17.1\\\",\\\"imageID\\\":\\\"quay.io/kuadrant/limitador-operator@sha256:3707fe24c6052d5adf240e12d34110706f0ac0877373830b67daab7c9a5c380d\\\",\\\"lastState\\\":{},\\\"name\\\":\\\"manager\\\",\\\"ready\\\":true,\\\"resources\\\":{\\\"limits\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"300Mi\\\"},\\\"requests\\\":{\\\"cpu\\\":\\\"200m\\\",\\\"memory\\\":\\\"200Mi\\\"}},\\\"restartCount\\\":0,\\\"started\\\":true,\\\"state\\\":{\\\"running\\\":{\\\"startedAt\\\":\\\"2026-07-08T17:46:24Z\\\"}},\\\"user\\\":{\\\"linux\\\":{\\\"gid\\\":0,\\\"supplementalGroups\\\":[0,1000680000],\\\"uid\\\":1000680000}},\\\"volumeMounts\\\":[{\\\"mountPath\\\":\\\"/var/run/secrets/kubernetes.io/serviceaccount\\\",\\\"name\\\":\\\"kube-api-access-qdfnl\\\",\\\"readOnly\\\":true,\\\"recursiveReadOnly\\\":\\\"Disabled\\\"}]}]}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-8h74r\": pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.503294 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.503277    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:36.505723 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:36.505688    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.508547 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.508501    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" containerName="manager" containerID="cri-o://c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b" gracePeriod=2
Jul 08 17:46:36.518220 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.518194    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"]
Jul 08 17:46:36.534031 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:36.533996    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.553145 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.553114    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kf8\" (UniqueName: \"kubernetes.io/projected/94f40f7c-4f5e-4a50-b98f-386899671fad-kube-api-access-k9kf8\") pod \"limitador-operator-controller-manager-859d7b78bd-6nztt\" (UID: \"94f40f7c-4f5e-4a50-b98f-386899671fad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:36.654026 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.653985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kf8\" (UniqueName: \"kubernetes.io/projected/94f40f7c-4f5e-4a50-b98f-386899671fad-kube-api-access-k9kf8\") pod \"limitador-operator-controller-manager-859d7b78bd-6nztt\" (UID: \"94f40f7c-4f5e-4a50-b98f-386899671fad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:36.665446 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.665395    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kf8\" (UniqueName: \"kubernetes.io/projected/94f40f7c-4f5e-4a50-b98f-386899671fad-kube-api-access-k9kf8\") pod \"limitador-operator-controller-manager-859d7b78bd-6nztt\" (UID: \"94f40f7c-4f5e-4a50-b98f-386899671fad\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:36.745791 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.745758    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.749905 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:36.749876    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:36.755141 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.755115    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdfnl\" (UniqueName: \"kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl\") pod \"998ba47f-4ffc-45a4-8c73-112e1617645b\" (UID: \"998ba47f-4ffc-45a4-8c73-112e1617645b\") "
Jul 08 17:46:36.757155 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.757131    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl" (OuterVolumeSpecName: "kube-api-access-qdfnl") pod "998ba47f-4ffc-45a4-8c73-112e1617645b" (UID: "998ba47f-4ffc-45a4-8c73-112e1617645b"). InnerVolumeSpecName "kube-api-access-qdfnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:46:36.817075 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.817048    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:36.856431 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.856379    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdfnl\" (UniqueName: \"kubernetes.io/projected/998ba47f-4ffc-45a4-8c73-112e1617645b-kube-api-access-qdfnl\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:46:36.949724 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:36.949691    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"]
Jul 08 17:46:36.952560 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:46:36.952529    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f40f7c_4f5e_4a50_b98f_386899671fad.slice/crio-c1e3f6b1e0117cbfdc443e33d754b464f9507dd13a3e5dc1371a5953ecd66495 WatchSource:0}: Error finding container c1e3f6b1e0117cbfdc443e33d754b464f9507dd13a3e5dc1371a5953ecd66495: Status 404 returned error can't find the container with id c1e3f6b1e0117cbfdc443e33d754b464f9507dd13a3e5dc1371a5953ecd66495
Jul 08 17:46:37.514072 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.514035    2575 generic.go:356] "Generic (PLEG): container finished" podID="998ba47f-4ffc-45a4-8c73-112e1617645b" containerID="c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b" exitCode=0
Jul 08 17:46:37.514551 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.514078    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:37.514551 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.514133    2575 scope.go:117] "RemoveContainer" containerID="c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b"
Jul 08 17:46:37.516012 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.515976    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt" event={"ID":"94f40f7c-4f5e-4a50-b98f-386899671fad","Type":"ContainerStarted","Data":"17116e470caa01b5b1d7619eec7b24c4270619ef836fe56bf69e7a156f32c6aa"}
Jul 08 17:46:37.516138 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.516031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt" event={"ID":"94f40f7c-4f5e-4a50-b98f-386899671fad","Type":"ContainerStarted","Data":"c1e3f6b1e0117cbfdc443e33d754b464f9507dd13a3e5dc1371a5953ecd66495"}
Jul 08 17:46:37.516138 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.516077    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:37.516369 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:37.516339    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:37.518426 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:37.518391    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:37.530727 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.530710    2575 scope.go:117] "RemoveContainer" containerID="c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b"
Jul 08 17:46:37.531001 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:37.530981    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b\": container with ID starting with c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b not found: ID does not exist" containerID="c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b"
Jul 08 17:46:37.531068 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.531010    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b"} err="failed to get container status \"c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b\": rpc error: code = NotFound desc = could not find container \"c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b\": container with ID starting with c9b19959299c36dce991575342b2ec87840e8efa76c879bfb48fce1a68821f4b not found: ID does not exist"
Jul 08 17:46:37.536197 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.536158    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt" podStartSLOduration=1.536144777 podStartE2EDuration="1.536144777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:37.53479567 +0000 UTC m=+786.401325729" watchObservedRunningTime="2026-07-08 17:46:37.536144777 +0000 UTC m=+786.402674819"
Jul 08 17:46:37.536857 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:46:37.536835    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-8h74r\" is forbidden: User \"system:node:ip-10-0-141-215.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-215.ec2.internal' and this object" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8h74r"
Jul 08 17:46:37.601822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:37.601781    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="998ba47f-4ffc-45a4-8c73-112e1617645b" path="/var/lib/kubelet/pods/998ba47f-4ffc-45a4-8c73-112e1617645b/volumes"
Jul 08 17:46:48.524021 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:48.523987    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-6nztt"
Jul 08 17:46:50.017104 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:46:50.017067    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:47:15.037647 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.037555    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-59cf5c85b5-p598j" podUID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" containerName="console" containerID="cri-o://73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe" gracePeriod=15
Jul 08 17:47:15.287694 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.287632    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:47:15.393131 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393092    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393131 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393131    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393376 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393150    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393376 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393191    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393376 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393207    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393376 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393233    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bvpk\" (UniqueName: \"kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393376 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393264    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca\") pod \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\" (UID: \"3e8d74a3-95b7-434f-a0d3-470e7fa66240\") "
Jul 08 17:47:15.393778 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393743    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config" (OuterVolumeSpecName: "console-config") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:15.393879 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393779    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:15.393937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393867    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca" (OuterVolumeSpecName: "service-ca") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:15.393937 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.393867    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:15.395351 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.395327    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:47:15.395805 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.395787    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk" (OuterVolumeSpecName: "kube-api-access-9bvpk") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "kube-api-access-9bvpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:47:15.395805 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.395790    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3e8d74a3-95b7-434f-a0d3-470e7fa66240" (UID: "3e8d74a3-95b7-434f-a0d3-470e7fa66240"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:47:15.494345 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494310    2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494345 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494341    2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-oauth-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494355    2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-oauth-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494367    2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-serving-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494379    2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-console-config\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494390    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e8d74a3-95b7-434f-a0d3-470e7fa66240-trusted-ca-bundle\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.494568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.494401    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bvpk\" (UniqueName: \"kubernetes.io/projected/3e8d74a3-95b7-434f-a0d3-470e7fa66240-kube-api-access-9bvpk\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:15.693524 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.693487    2575 generic.go:356] "Generic (PLEG): container finished" podID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" containerID="73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe" exitCode=0
Jul 08 17:47:15.693714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.693538    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59cf5c85b5-p598j"
Jul 08 17:47:15.693714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.693577    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5c85b5-p598j" event={"ID":"3e8d74a3-95b7-434f-a0d3-470e7fa66240","Type":"ContainerDied","Data":"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"}
Jul 08 17:47:15.693714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.693638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59cf5c85b5-p598j" event={"ID":"3e8d74a3-95b7-434f-a0d3-470e7fa66240","Type":"ContainerDied","Data":"fd8c681c1e42167640aadc3d155a1f440aed43d15a59c15f0c2cb6f890225731"}
Jul 08 17:47:15.693714 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.693664    2575 scope.go:117] "RemoveContainer" containerID="73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"
Jul 08 17:47:15.701890 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.701868    2575 scope.go:117] "RemoveContainer" containerID="73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"
Jul 08 17:47:15.702157 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:47:15.702138    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe\": container with ID starting with 73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe not found: ID does not exist" containerID="73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"
Jul 08 17:47:15.702206 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.702169    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe"} err="failed to get container status \"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe\": rpc error: code = NotFound desc = could not find container \"73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe\": container with ID starting with 73ae40f881ea028a0df2282be9ae59fe8ad5f2c7828f9225298aa98b6b9a13fe not found: ID does not exist"
Jul 08 17:47:15.710401 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.710375    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:47:15.714527 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:15.714503    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59cf5c85b5-p598j"]
Jul 08 17:47:17.602156 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:17.602121    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" path="/var/lib/kubelet/pods/3e8d74a3-95b7-434f-a0d3-470e7fa66240/volumes"
Jul 08 17:47:22.169636 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.169600    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:22.170080 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.169921    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" containerName="console"
Jul 08 17:47:22.170080 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.169936    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" containerName="console"
Jul 08 17:47:22.170080 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.169999    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e8d74a3-95b7-434f-a0d3-470e7fa66240" containerName="console"
Jul 08 17:47:22.174280 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.174258    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.177123 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.177101    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 17:47:22.177234 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.177109    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2h78s\""
Jul 08 17:47:22.186037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.186012    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:22.274039 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.274009    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:22.351607 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.351571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn6h4\" (UniqueName: \"kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.351784 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.351620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.452867 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.452759    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn6h4\" (UniqueName: \"kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.453034 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.452929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.453590 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.453567    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.461900 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.461880    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn6h4\" (UniqueName: \"kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4\") pod \"limitador-limitador-64c94fd64f-k4mr2\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.484763 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.484728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:22.622795 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.622765    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:22.625471 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:47:22.625438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b686f69_e0bb_45be_8f40_6e2c31fcef09.slice/crio-20894657ea8fc460091a93c0cdc1b64fd9f420a0c390567ac1bc4117300bfe9a WatchSource:0}: Error finding container 20894657ea8fc460091a93c0cdc1b64fd9f420a0c390567ac1bc4117300bfe9a: Status 404 returned error can't find the container with id 20894657ea8fc460091a93c0cdc1b64fd9f420a0c390567ac1bc4117300bfe9a
Jul 08 17:47:22.724847 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:22.724761    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" event={"ID":"2b686f69-e0bb-45be-8f40-6e2c31fcef09","Type":"ContainerStarted","Data":"20894657ea8fc460091a93c0cdc1b64fd9f420a0c390567ac1bc4117300bfe9a"}
Jul 08 17:47:25.740540 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:25.740439    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" event={"ID":"2b686f69-e0bb-45be-8f40-6e2c31fcef09","Type":"ContainerStarted","Data":"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"}
Jul 08 17:47:25.740980 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:25.740574    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:25.761090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:25.761034    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" podStartSLOduration=0.939609253 podStartE2EDuration="3.761018176s" totalImagesPullingTime="2.821408923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:25.759601716 +0000 UTC m=+834.626131780" watchObservedRunningTime="2026-07-08 17:47:25.761018176 +0000 UTC m=+834.627548218"
Jul 08 17:47:36.745554 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:36.745523    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:37.187303 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.187270    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:37.187505 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.187480    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" podUID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" containerName="limitador" containerID="cri-o://b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa" gracePeriod=30
Jul 08 17:47:37.730105 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.730078    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:37.754945 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.754870    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file\") pod \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") "
Jul 08 17:47:37.755310 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.755218    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file" (OuterVolumeSpecName: "config-file") pod "2b686f69-e0bb-45be-8f40-6e2c31fcef09" (UID: "2b686f69-e0bb-45be-8f40-6e2c31fcef09"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 17:47:37.795755 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.795722    2575 generic.go:356] "Generic (PLEG): container finished" podID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" containerID="b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa" exitCode=0
Jul 08 17:47:37.795925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.795771    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"
Jul 08 17:47:37.795925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.795816    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" event={"ID":"2b686f69-e0bb-45be-8f40-6e2c31fcef09","Type":"ContainerDied","Data":"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"}
Jul 08 17:47:37.795925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.795873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-k4mr2" event={"ID":"2b686f69-e0bb-45be-8f40-6e2c31fcef09","Type":"ContainerDied","Data":"20894657ea8fc460091a93c0cdc1b64fd9f420a0c390567ac1bc4117300bfe9a"}
Jul 08 17:47:37.795925 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.795901    2575 scope.go:117] "RemoveContainer" containerID="b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"
Jul 08 17:47:37.803843 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.803822    2575 scope.go:117] "RemoveContainer" containerID="b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"
Jul 08 17:47:37.804104 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:47:37.804085    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa\": container with ID starting with b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa not found: ID does not exist" containerID="b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"
Jul 08 17:47:37.804167 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.804125    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa"} err="failed to get container status \"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa\": rpc error: code = NotFound desc = could not find container \"b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa\": container with ID starting with b4dfd41a09717b88202042062be7a94346d07b4f1f7dea7035ffa4821388cffa not found: ID does not exist"
Jul 08 17:47:37.855873 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.855832    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn6h4\" (UniqueName: \"kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4\") pod \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\" (UID: \"2b686f69-e0bb-45be-8f40-6e2c31fcef09\") "
Jul 08 17:47:37.856053 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.856044    2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2b686f69-e0bb-45be-8f40-6e2c31fcef09-config-file\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:37.857853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.857820    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4" (OuterVolumeSpecName: "kube-api-access-kn6h4") pod "2b686f69-e0bb-45be-8f40-6e2c31fcef09" (UID: "2b686f69-e0bb-45be-8f40-6e2c31fcef09"). InnerVolumeSpecName "kube-api-access-kn6h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:47:37.957100 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:37.957063    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn6h4\" (UniqueName: \"kubernetes.io/projected/2b686f69-e0bb-45be-8f40-6e2c31fcef09-kube-api-access-kn6h4\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:38.118853 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.118821    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:38.120428 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.120401    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-k4mr2"]
Jul 08 17:47:38.795956 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.795921    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"]
Jul 08 17:47:38.797086 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.797058    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" containerName="limitador"
Jul 08 17:47:38.797283 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.797270    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" containerName="limitador"
Jul 08 17:47:38.797587 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.797571    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" containerName="limitador"
Jul 08 17:47:38.802939 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.802914    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.806110 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.806090    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 17:47:38.806210 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.806093    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xv54w\""
Jul 08 17:47:38.806901 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.806883    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 08 17:47:38.807017 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.806913    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 17:47:38.812404 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.812381    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"]
Jul 08 17:47:38.863909 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.863869    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r2pb\" (UniqueName: \"kubernetes.io/projected/40c125c2-6048-41de-b03a-3821e09ac5f7-kube-api-access-2r2pb\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.864085 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.863919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40c125c2-6048-41de-b03a-3821e09ac5f7-data\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.965102 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.965061    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r2pb\" (UniqueName: \"kubernetes.io/projected/40c125c2-6048-41de-b03a-3821e09ac5f7-kube-api-access-2r2pb\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.965102 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.965109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40c125c2-6048-41de-b03a-3821e09ac5f7-data\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.965500 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.965482    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/40c125c2-6048-41de-b03a-3821e09ac5f7-data\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:38.974358 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:38.974327    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r2pb\" (UniqueName: \"kubernetes.io/projected/40c125c2-6048-41de-b03a-3821e09ac5f7-kube-api-access-2r2pb\") pod \"postgres-69fb4594cf-ngfrh\" (UID: \"40c125c2-6048-41de-b03a-3821e09ac5f7\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:39.115111 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:39.115083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:39.246379 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:39.246349    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"]
Jul 08 17:47:39.248342 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:47:39.248313    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c125c2_6048_41de_b03a_3821e09ac5f7.slice/crio-f1e33ec2bad43d6746c6edb47fd39f0ee721173fda328ee641df77fc53f0f399 WatchSource:0}: Error finding container f1e33ec2bad43d6746c6edb47fd39f0ee721173fda328ee641df77fc53f0f399: Status 404 returned error can't find the container with id f1e33ec2bad43d6746c6edb47fd39f0ee721173fda328ee641df77fc53f0f399
Jul 08 17:47:39.602737 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:39.602657    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b686f69-e0bb-45be-8f40-6e2c31fcef09" path="/var/lib/kubelet/pods/2b686f69-e0bb-45be-8f40-6e2c31fcef09/volumes"
Jul 08 17:47:39.810767 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:39.810724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh" event={"ID":"40c125c2-6048-41de-b03a-3821e09ac5f7","Type":"ContainerStarted","Data":"f1e33ec2bad43d6746c6edb47fd39f0ee721173fda328ee641df77fc53f0f399"}
Jul 08 17:47:44.835458 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:44.835351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh" event={"ID":"40c125c2-6048-41de-b03a-3821e09ac5f7","Type":"ContainerStarted","Data":"0387bf37f01b4dbc1cfdc1ae040f775b2c3ec8e280ff05f16804704a2bb562f6"}
Jul 08 17:47:44.835824 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:44.835486    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:44.854823 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:44.854772    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh" podStartSLOduration=1.684825405 podStartE2EDuration="6.854758583s" totalImagesPullingTime="5.169933178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:44.852667085 +0000 UTC m=+853.719197162" watchObservedRunningTime="2026-07-08 17:47:44.854758583 +0000 UTC m=+853.721288624"
Jul 08 17:47:50.869706 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:50.869670    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-ngfrh"
Jul 08 17:47:51.415978 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.415939    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:51.422035 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.422009    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:51.424710 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.424690    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wmcqs\""
Jul 08 17:47:51.428012 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.427988    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:51.470726 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.470696    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dcvg\" (UniqueName: \"kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg\") pod \"authorino-5d4b67c446-5hp2w\" (UID: \"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa\") " pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:51.572091 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.572055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dcvg\" (UniqueName: \"kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg\") pod \"authorino-5d4b67c446-5hp2w\" (UID: \"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa\") " pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:51.580289 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.580266    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dcvg\" (UniqueName: \"kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg\") pod \"authorino-5d4b67c446-5hp2w\" (UID: \"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa\") " pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:51.655837 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.655805    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:51.656059 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.656047    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:51.794958 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.794931    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:51.797474 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:47:51.797439    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd89ce6e_eef1_42e6_aa0b_2a162aa26eaa.slice/crio-3f7490dc2b0bba72f273339115f42c8204e6491a6bc2e0e1925722e6331e98e2 WatchSource:0}: Error finding container 3f7490dc2b0bba72f273339115f42c8204e6491a6bc2e0e1925722e6331e98e2: Status 404 returned error can't find the container with id 3f7490dc2b0bba72f273339115f42c8204e6491a6bc2e0e1925722e6331e98e2
Jul 08 17:47:51.868761 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:51.868724    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" event={"ID":"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa","Type":"ContainerStarted","Data":"3f7490dc2b0bba72f273339115f42c8204e6491a6bc2e0e1925722e6331e98e2"}
Jul 08 17:47:55.892877 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:55.892841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" event={"ID":"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa","Type":"ContainerStarted","Data":"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"}
Jul 08 17:47:55.893297 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:55.892914    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" podUID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" containerName="authorino" containerID="cri-o://27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab" gracePeriod=30
Jul 08 17:47:55.913016 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:55.912971    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" podStartSLOduration=1.70654152 podStartE2EDuration="4.912956534s" totalImagesPullingTime="3.206415014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:55.91194469 +0000 UTC m=+864.778474728" watchObservedRunningTime="2026-07-08 17:47:55.912956534 +0000 UTC m=+864.779486576"
Jul 08 17:47:56.137434 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.137397    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:56.215564 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.215477    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dcvg\" (UniqueName: \"kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg\") pod \"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa\" (UID: \"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa\") "
Jul 08 17:47:56.217544 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.217504    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg" (OuterVolumeSpecName: "kube-api-access-7dcvg") pod "fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" (UID: "fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa"). InnerVolumeSpecName "kube-api-access-7dcvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:47:56.317076 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.317036    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dcvg\" (UniqueName: \"kubernetes.io/projected/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa-kube-api-access-7dcvg\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:47:56.899184 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.899144    2575 generic.go:356] "Generic (PLEG): container finished" podID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" containerID="27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab" exitCode=0
Jul 08 17:47:56.899661 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.899199    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-5hp2w"
Jul 08 17:47:56.899661 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.899219    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" event={"ID":"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa","Type":"ContainerDied","Data":"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"}
Jul 08 17:47:56.899661 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.899259    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-5hp2w" event={"ID":"fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa","Type":"ContainerDied","Data":"3f7490dc2b0bba72f273339115f42c8204e6491a6bc2e0e1925722e6331e98e2"}
Jul 08 17:47:56.899661 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.899277    2575 scope.go:117] "RemoveContainer" containerID="27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"
Jul 08 17:47:56.908887 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.908864    2575 scope.go:117] "RemoveContainer" containerID="27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"
Jul 08 17:47:56.909193 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:47:56.909174    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab\": container with ID starting with 27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab not found: ID does not exist" containerID="27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"
Jul 08 17:47:56.909254 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.909202    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab"} err="failed to get container status \"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab\": rpc error: code = NotFound desc = could not find container \"27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab\": container with ID starting with 27ef096826e373c8211774ba772b1a76a748348fafc66487588c8d82521cfcab not found: ID does not exist"
Jul 08 17:47:56.922631 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.922594    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:56.924133 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:56.924108    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-5hp2w"]
Jul 08 17:47:57.602404 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:57.602367    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" path="/var/lib/kubelet/pods/fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa/volumes"
Jul 08 17:47:58.010379 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.010344    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:47:58.010819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.010676    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" containerName="authorino"
Jul 08 17:47:58.010819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.010688    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" containerName="authorino"
Jul 08 17:47:58.010819 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.010759    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd89ce6e-eef1-42e6-aa0b-2a162aa26eaa" containerName="authorino"
Jul 08 17:47:58.066079 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.066039    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:47:58.066238 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.066146    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.068968 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.068936    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfw6g\""
Jul 08 17:47:58.069252 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.069230    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 17:47:58.069252 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.069243    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 17:47:58.131866 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.131828    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.132033 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.131933    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tftrj\" (UniqueName: \"kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.222230 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.222195    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:47:58.232872 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.232834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tftrj\" (UniqueName: \"kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.233061 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.232890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.235721 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.235676    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.242266 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.242238    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tftrj\" (UniqueName: \"kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj\") pod \"maas-controller-867d5bdd4f-4z89t\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") " pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.251678 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.251638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:47:58.251815 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.251746    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.333852 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.333759    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.333852 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.333814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvb77\" (UniqueName: \"kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.376653 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.376599    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:47:58.434653 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.434618    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.434817 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.434686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvb77\" (UniqueName: \"kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.437095 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.437073    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.444219 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.444186    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvb77\" (UniqueName: \"kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77\") pod \"maas-controller-7f8df59f6f-g9gtl\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") " pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.543823 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.543735    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:47:58.562315 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.562287    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:47:58.721707 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.721678    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:47:58.722728 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:47:58.722701    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416d0623_4df4_424a_87c3_032697a58839.slice/crio-9df89664e6ee2c22a70e3013f5dba3762540bd0733574f03f02c2d94277e9b23 WatchSource:0}: Error finding container 9df89664e6ee2c22a70e3013f5dba3762540bd0733574f03f02c2d94277e9b23: Status 404 returned error can't find the container with id 9df89664e6ee2c22a70e3013f5dba3762540bd0733574f03f02c2d94277e9b23
Jul 08 17:47:58.911091 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.911055    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" event={"ID":"a157cf5a-c6c3-4e2d-b2e1-2305261e8135","Type":"ContainerStarted","Data":"026e80e970e707a52f7a64ed385ef42cb9d0d9099caf347e762402858450865d"}
Jul 08 17:47:58.912136 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:47:58.912109    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" event={"ID":"416d0623-4df4-424a-87c3-032697a58839","Type":"ContainerStarted","Data":"9df89664e6ee2c22a70e3013f5dba3762540bd0733574f03f02c2d94277e9b23"}
Jul 08 17:48:01.931662 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.931604    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" event={"ID":"a157cf5a-c6c3-4e2d-b2e1-2305261e8135","Type":"ContainerStarted","Data":"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"}
Jul 08 17:48:01.932245 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.931685    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:48:01.933089 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.933067    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" event={"ID":"416d0623-4df4-424a-87c3-032697a58839","Type":"ContainerStarted","Data":"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"}
Jul 08 17:48:01.933188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.933118    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:48:01.950460 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.950383    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" podStartSLOduration=2.50670851 podStartE2EDuration="4.950370144s" totalImagesPullingTime="2.443661634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:01.948900088 +0000 UTC m=+870.815430143" watchObservedRunningTime="2026-07-08 17:48:01.950370144 +0000 UTC m=+870.816900264"
Jul 08 17:48:01.966402 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:01.966343    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" podStartSLOduration=1.7135115939999999 podStartE2EDuration="3.966327116s" totalImagesPullingTime="2.252815522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:01.966040981 +0000 UTC m=+870.832571023" watchObservedRunningTime="2026-07-08 17:48:01.966327116 +0000 UTC m=+870.832857157"
Jul 08 17:48:12.943959 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:12.943920    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:48:12.944472 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:12.944130    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:48:13.010640 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.010608    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:48:13.010822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.010788    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" podUID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" containerName="manager" containerID="cri-o://40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f" gracePeriod=30
Jul 08 17:48:13.254295 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.254268    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:48:13.366488 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.366443    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert\") pod \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") "
Jul 08 17:48:13.366674 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.366505    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tftrj\" (UniqueName: \"kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj\") pod \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\" (UID: \"a157cf5a-c6c3-4e2d-b2e1-2305261e8135\") "
Jul 08 17:48:13.368677 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.368641    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj" (OuterVolumeSpecName: "kube-api-access-tftrj") pod "a157cf5a-c6c3-4e2d-b2e1-2305261e8135" (UID: "a157cf5a-c6c3-4e2d-b2e1-2305261e8135"). InnerVolumeSpecName "kube-api-access-tftrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:48:13.368806 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.368715    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a157cf5a-c6c3-4e2d-b2e1-2305261e8135" (UID: "a157cf5a-c6c3-4e2d-b2e1-2305261e8135"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:48:13.467257 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.467213    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-webhook-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:48:13.467257 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.467249    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tftrj\" (UniqueName: \"kubernetes.io/projected/a157cf5a-c6c3-4e2d-b2e1-2305261e8135-kube-api-access-tftrj\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:48:13.624952 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:48:13.624903    2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda157cf5a_c6c3_4e2d_b2e1_2305261e8135.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda157cf5a_c6c3_4e2d_b2e1_2305261e8135.slice/crio-026e80e970e707a52f7a64ed385ef42cb9d0d9099caf347e762402858450865d\": RecentStats: unable to find data in memory cache]"
Jul 08 17:48:13.993743 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.993703    2575 generic.go:356] "Generic (PLEG): container finished" podID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" containerID="40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f" exitCode=0
Jul 08 17:48:13.994188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.993749    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-867d5bdd4f-4z89t"
Jul 08 17:48:13.994188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.993789    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" event={"ID":"a157cf5a-c6c3-4e2d-b2e1-2305261e8135","Type":"ContainerDied","Data":"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"}
Jul 08 17:48:13.994188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.993841    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-867d5bdd4f-4z89t" event={"ID":"a157cf5a-c6c3-4e2d-b2e1-2305261e8135","Type":"ContainerDied","Data":"026e80e970e707a52f7a64ed385ef42cb9d0d9099caf347e762402858450865d"}
Jul 08 17:48:13.994188 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:13.993863    2575 scope.go:117] "RemoveContainer" containerID="40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"
Jul 08 17:48:14.002632 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:14.002613    2575 scope.go:117] "RemoveContainer" containerID="40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"
Jul 08 17:48:14.002920 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:48:14.002901    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f\": container with ID starting with 40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f not found: ID does not exist" containerID="40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"
Jul 08 17:48:14.002962 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:14.002929    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f"} err="failed to get container status \"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f\": rpc error: code = NotFound desc = could not find container \"40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f\": container with ID starting with 40715c34147d2e1bd46df911f3d270f9d1712b1701891c83615d5be547e1797f not found: ID does not exist"
Jul 08 17:48:14.011942 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:14.011916    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:48:14.017071 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:14.017038    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-867d5bdd4f-4z89t"]
Jul 08 17:48:15.602342 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:15.602307    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" path="/var/lib/kubelet/pods/a157cf5a-c6c3-4e2d-b2e1-2305261e8135/volumes"
Jul 08 17:48:31.523671 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:31.523595    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:48:31.524809 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:31.524791    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:48:34.096251 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.096219    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"]
Jul 08 17:48:34.096822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.096553    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" containerName="manager"
Jul 08 17:48:34.096822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.096566    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" containerName="manager"
Jul 08 17:48:34.096822 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.096644    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a157cf5a-c6c3-4e2d-b2e1-2305261e8135" containerName="manager"
Jul 08 17:48:34.101076 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.101059    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.103604 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.103582    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tvdqk\""
Jul 08 17:48:34.103707 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.103643    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 08 17:48:34.113466 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.112525    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"]
Jul 08 17:48:34.241949 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.241916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.242127 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.242008    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtn7q\" (UniqueName: \"kubernetes.io/projected/08307a83-b6cc-471d-acc2-c5a4e8020fa5-kube-api-access-rtn7q\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.242127 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.242082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08307a83-b6cc-471d-acc2-c5a4e8020fa5-openshift-service-ca\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.342843 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.342803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08307a83-b6cc-471d-acc2-c5a4e8020fa5-openshift-service-ca\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.343037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.342869    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.343037 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.342911    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtn7q\" (UniqueName: \"kubernetes.io/projected/08307a83-b6cc-471d-acc2-c5a4e8020fa5-kube-api-access-rtn7q\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.343037 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:48:34.343023    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 08 17:48:34.343184 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:48:34.343098    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls podName:08307a83-b6cc-471d-acc2-c5a4e8020fa5 nodeName:}" failed. No retries permitted until 2026-07-08 17:48:34.843080009 +0000 UTC m=+903.709610029 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls") pod "maas-api-6bf665fbcd-8s6j7" (UID: "08307a83-b6cc-471d-acc2-c5a4e8020fa5") : secret "maas-api-serving-cert" not found
Jul 08 17:48:34.343626 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.343606    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/08307a83-b6cc-471d-acc2-c5a4e8020fa5-openshift-service-ca\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.354057 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.353997    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtn7q\" (UniqueName: \"kubernetes.io/projected/08307a83-b6cc-471d-acc2-c5a4e8020fa5-kube-api-access-rtn7q\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.615510 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.615480    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cnzd"]
Jul 08 17:48:34.618875 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.618859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.621315 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.621296    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 08 17:48:34.621432 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.621331    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-94dlx\""
Jul 08 17:48:34.629579 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.629556    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cnzd"]
Jul 08 17:48:34.746082 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.746046    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsj9d\" (UniqueName: \"kubernetes.io/projected/68bea353-a813-4d6f-88b6-cdefd72b8eae-kube-api-access-wsj9d\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.746245 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.746132    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68bea353-a813-4d6f-88b6-cdefd72b8eae-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.846996 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.846959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68bea353-a813-4d6f-88b6-cdefd72b8eae-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.847176 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.847005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.847176 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.847068    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsj9d\" (UniqueName: \"kubernetes.io/projected/68bea353-a813-4d6f-88b6-cdefd72b8eae-kube-api-access-wsj9d\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.847830 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.847806    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68bea353-a813-4d6f-88b6-cdefd72b8eae-plugins-config-volume\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.849474 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.849452    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/08307a83-b6cc-471d-acc2-c5a4e8020fa5-maas-api-tls\") pod \"maas-api-6bf665fbcd-8s6j7\" (UID: \"08307a83-b6cc-471d-acc2-c5a4e8020fa5\") " pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:34.855560 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.855540    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsj9d\" (UniqueName: \"kubernetes.io/projected/68bea353-a813-4d6f-88b6-cdefd72b8eae-kube-api-access-wsj9d\") pod \"payload-processing-58f86c7798-4cnzd\" (UID: \"68bea353-a813-4d6f-88b6-cdefd72b8eae\") " pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:34.930197 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:34.930105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:35.013769 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:35.013721    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:35.067201 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:35.067154    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4cnzd"]
Jul 08 17:48:35.069937 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:48:35.069908    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68bea353_a813_4d6f_88b6_cdefd72b8eae.slice/crio-35812f4e222a1a658f7a554bd7f83f4c40ddab9765fb93a24d17f0b0dec09a37 WatchSource:0}: Error finding container 35812f4e222a1a658f7a554bd7f83f4c40ddab9765fb93a24d17f0b0dec09a37: Status 404 returned error can't find the container with id 35812f4e222a1a658f7a554bd7f83f4c40ddab9765fb93a24d17f0b0dec09a37
Jul 08 17:48:35.101385 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:35.101335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd" event={"ID":"68bea353-a813-4d6f-88b6-cdefd72b8eae","Type":"ContainerStarted","Data":"35812f4e222a1a658f7a554bd7f83f4c40ddab9765fb93a24d17f0b0dec09a37"}
Jul 08 17:48:35.160263 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:35.160138    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"]
Jul 08 17:48:35.162275 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:48:35.162244    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08307a83_b6cc_471d_acc2_c5a4e8020fa5.slice/crio-1739e56b79082a1716f73a0521e1f6982f1add98961eeda0e40c227db3f9f007 WatchSource:0}: Error finding container 1739e56b79082a1716f73a0521e1f6982f1add98961eeda0e40c227db3f9f007: Status 404 returned error can't find the container with id 1739e56b79082a1716f73a0521e1f6982f1add98961eeda0e40c227db3f9f007
Jul 08 17:48:36.106932 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:36.106902    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7" event={"ID":"08307a83-b6cc-471d-acc2-c5a4e8020fa5","Type":"ContainerStarted","Data":"1739e56b79082a1716f73a0521e1f6982f1add98961eeda0e40c227db3f9f007"}
Jul 08 17:48:37.112977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.112938    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd" event={"ID":"68bea353-a813-4d6f-88b6-cdefd72b8eae","Type":"ContainerStarted","Data":"d6b470256e8c71b095c8476317d6541d1f268a08d1ea0df49383ef32a3521193"}
Jul 08 17:48:37.113427 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.113006    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:37.114366 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.114332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7" event={"ID":"08307a83-b6cc-471d-acc2-c5a4e8020fa5","Type":"ContainerStarted","Data":"465a5c29445d22cf20dfe534600e2be0e00ea4401ff85e86b8376210deab764c"}
Jul 08 17:48:37.114476 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.114384    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:37.129730 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.129600    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd" podStartSLOduration=1.762395157 podStartE2EDuration="3.129583634s" totalImagesPullingTime="1.367188477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:37.128931447 +0000 UTC m=+905.995461519" watchObservedRunningTime="2026-07-08 17:48:37.129583634 +0000 UTC m=+905.996113677"
Jul 08 17:48:37.147795 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:37.147749    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7" podStartSLOduration=1.411415551 podStartE2EDuration="3.147731858s" totalImagesPullingTime="1.736316307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:37.145848728 +0000 UTC m=+906.012378769" watchObservedRunningTime="2026-07-08 17:48:37.147731858 +0000 UTC m=+906.014261899"
Jul 08 17:48:43.125512 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:43.125482    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6bf665fbcd-8s6j7"
Jul 08 17:48:48.121602 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:48.121567    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4cnzd"
Jul 08 17:48:59.511783 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.511747    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"]
Jul 08 17:48:59.515082 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.515064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.518316 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.518296    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 17:48:59.518431 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.518376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 08 17:48:59.518431 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.518377    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 17:48:59.519135 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.519119    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqlnk\""
Jul 08 17:48:59.525583 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.525560    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"]
Jul 08 17:48:59.652269 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652238    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.652441 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tctv7\" (UniqueName: \"kubernetes.io/projected/314006b1-864f-4e00-ac0d-3a5f190f0121-kube-api-access-tctv7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.652441 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652379    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.652536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652486    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.652536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652516    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.652536 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.652531    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314006b1-864f-4e00-ac0d-3a5f190f0121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753197 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753197 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tctv7\" (UniqueName: \"kubernetes.io/projected/314006b1-864f-4e00-ac0d-3a5f190f0121-kube-api-access-tctv7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753392 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753234    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753392 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753305    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753392 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753392 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314006b1-864f-4e00-ac0d-3a5f190f0121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753618 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753541    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753733 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753716    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.753791 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.753769    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.755559 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.755537    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/314006b1-864f-4e00-ac0d-3a5f190f0121-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.755718 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.755702    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/314006b1-864f-4e00-ac0d-3a5f190f0121-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.761908 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.761845    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tctv7\" (UniqueName: \"kubernetes.io/projected/314006b1-864f-4e00-ac0d-3a5f190f0121-kube-api-access-tctv7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5\" (UID: \"314006b1-864f-4e00-ac0d-3a5f190f0121\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.825443 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.825381    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:48:59.958311 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:48:59.958282    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"]
Jul 08 17:49:00.221600 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:00.221559    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5" event={"ID":"314006b1-864f-4e00-ac0d-3a5f190f0121","Type":"ContainerStarted","Data":"c22a08e246565459639baef512d7f421de6be6a707e9e2f7a507acecf3ce2b1f"}
Jul 08 17:49:01.227374 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:01.227285    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5" event={"ID":"314006b1-864f-4e00-ac0d-3a5f190f0121","Type":"ContainerStarted","Data":"c1357d193832c55baa3550257564692fe86b8797163ebfcc0bef92c60f079928"}
Jul 08 17:49:01.245886 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:01.245830    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5" podStartSLOduration=1.235919172 podStartE2EDuration="2.245814829s" totalImagesPullingTime="1.009895657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:01.245365348 +0000 UTC m=+930.111895405" watchObservedRunningTime="2026-07-08 17:49:01.245814829 +0000 UTC m=+930.112344871"
Jul 08 17:49:09.826283 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:09.826252    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:49:09.826811 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:09.826340    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:49:09.838568 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:09.838546    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:49:10.285044 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:49:10.285014    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5"
Jul 08 17:52:28.163650 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.163614    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:52:28.164185 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.163823    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" podUID="416d0623-4df4-424a-87c3-032697a58839" containerName="manager" containerID="cri-o://8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54" gracePeriod=30
Jul 08 17:52:28.412080 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.412057    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:52:28.523977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.523908    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert\") pod \"416d0623-4df4-424a-87c3-032697a58839\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") "
Jul 08 17:52:28.523977 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.523963    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvb77\" (UniqueName: \"kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77\") pod \"416d0623-4df4-424a-87c3-032697a58839\" (UID: \"416d0623-4df4-424a-87c3-032697a58839\") "
Jul 08 17:52:28.525932 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.525901    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77" (OuterVolumeSpecName: "kube-api-access-gvb77") pod "416d0623-4df4-424a-87c3-032697a58839" (UID: "416d0623-4df4-424a-87c3-032697a58839"). InnerVolumeSpecName "kube-api-access-gvb77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 17:52:28.526048 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.525938    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "416d0623-4df4-424a-87c3-032697a58839" (UID: "416d0623-4df4-424a-87c3-032697a58839"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 17:52:28.624632 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.624602    2575 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416d0623-4df4-424a-87c3-032697a58839-webhook-cert\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:52:28.624632 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:28.624627    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvb77\" (UniqueName: \"kubernetes.io/projected/416d0623-4df4-424a-87c3-032697a58839-kube-api-access-gvb77\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 17:52:29.153876 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.153839    2575 generic.go:356] "Generic (PLEG): container finished" podID="416d0623-4df4-424a-87c3-032697a58839" containerID="8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54" exitCode=0
Jul 08 17:52:29.154050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.153884    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl"
Jul 08 17:52:29.154050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.153926    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" event={"ID":"416d0623-4df4-424a-87c3-032697a58839","Type":"ContainerDied","Data":"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"}
Jul 08 17:52:29.154050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.153982    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-g9gtl" event={"ID":"416d0623-4df4-424a-87c3-032697a58839","Type":"ContainerDied","Data":"9df89664e6ee2c22a70e3013f5dba3762540bd0733574f03f02c2d94277e9b23"}
Jul 08 17:52:29.154050 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.154012    2575 scope.go:117] "RemoveContainer" containerID="8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"
Jul 08 17:52:29.162894 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.162875    2575 scope.go:117] "RemoveContainer" containerID="8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"
Jul 08 17:52:29.163205 ip-10-0-141-215 kubenswrapper[2575]: E0708 17:52:29.163183    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54\": container with ID starting with 8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54 not found: ID does not exist" containerID="8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"
Jul 08 17:52:29.163254 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.163214    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54"} err="failed to get container status \"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54\": rpc error: code = NotFound desc = could not find container \"8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54\": container with ID starting with 8a551d751e15cc6e1e7fb638e5af9dddf3f97a65c3a5ebf29465a3c9a0ae3f54 not found: ID does not exist"
Jul 08 17:52:29.176909 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.176870    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:52:29.183741 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.183712    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-g9gtl"]
Jul 08 17:52:29.602735 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.602651    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="416d0623-4df4-424a-87c3-032697a58839" path="/var/lib/kubelet/pods/416d0623-4df4-424a-87c3-032697a58839/volumes"
Jul 08 17:52:29.931989 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.931954    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-jwzxj"]
Jul 08 17:52:29.932302 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.932290    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="416d0623-4df4-424a-87c3-032697a58839" containerName="manager"
Jul 08 17:52:29.932345 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.932304    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="416d0623-4df4-424a-87c3-032697a58839" containerName="manager"
Jul 08 17:52:29.932378 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.932359    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="416d0623-4df4-424a-87c3-032697a58839" containerName="manager"
Jul 08 17:52:29.936638 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.936622    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:29.939647 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.939630    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 08 17:52:29.940751 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.940734    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 08 17:52:29.940854 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.940815    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qfw6g\""
Jul 08 17:52:29.948082 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:29.948060    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-jwzxj"]
Jul 08 17:52:30.037898 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.037861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kxtb\" (UniqueName: \"kubernetes.io/projected/59e17f33-aae1-475a-aaf8-0d7e8e318a67-kube-api-access-7kxtb\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.037898 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.037899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59e17f33-aae1-475a-aaf8-0d7e8e318a67-webhook-cert\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.138791 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.138758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kxtb\" (UniqueName: \"kubernetes.io/projected/59e17f33-aae1-475a-aaf8-0d7e8e318a67-kube-api-access-7kxtb\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.138970 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.138798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59e17f33-aae1-475a-aaf8-0d7e8e318a67-webhook-cert\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.141219 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.141190    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/59e17f33-aae1-475a-aaf8-0d7e8e318a67-webhook-cert\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.148148 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.148122    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kxtb\" (UniqueName: \"kubernetes.io/projected/59e17f33-aae1-475a-aaf8-0d7e8e318a67-kube-api-access-7kxtb\") pod \"maas-controller-7f8df59f6f-jwzxj\" (UID: \"59e17f33-aae1-475a-aaf8-0d7e8e318a67\") " pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.247090 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.246998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:30.373813 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.373638    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8df59f6f-jwzxj"]
Jul 08 17:52:30.376528 ip-10-0-141-215 kubenswrapper[2575]: W0708 17:52:30.376506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e17f33_aae1_475a_aaf8_0d7e8e318a67.slice/crio-ad56326044e825f13780ae9cce399bdc900420ddd781ddf9ef9bf07363801285 WatchSource:0}: Error finding container ad56326044e825f13780ae9cce399bdc900420ddd781ddf9ef9bf07363801285: Status 404 returned error can't find the container with id ad56326044e825f13780ae9cce399bdc900420ddd781ddf9ef9bf07363801285
Jul 08 17:52:30.377865 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:30.377843    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 17:52:31.165010 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:31.164977    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj" event={"ID":"59e17f33-aae1-475a-aaf8-0d7e8e318a67","Type":"ContainerStarted","Data":"e8352b573a0ba077f5947b6759fd076d0f880fd695d6125cc051ca4a7820dda7"}
Jul 08 17:52:31.165209 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:31.165165    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:52:31.165259 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:31.165213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj" event={"ID":"59e17f33-aae1-475a-aaf8-0d7e8e318a67","Type":"ContainerStarted","Data":"ad56326044e825f13780ae9cce399bdc900420ddd781ddf9ef9bf07363801285"}
Jul 08 17:52:31.184098 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:31.184048    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj" podStartSLOduration=1.475257581 podStartE2EDuration="2.184030052s" totalImagesPullingTime="708.772471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:52:31.182569045 +0000 UTC m=+1140.049099129" watchObservedRunningTime="2026-07-08 17:52:31.184030052 +0000 UTC m=+1140.050560093"
Jul 08 17:52:42.175117 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:52:42.175084    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8df59f6f-jwzxj"
Jul 08 17:53:31.549821 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:53:31.549789    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:53:31.552943 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:53:31.552906    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:58:31.577177 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:58:31.577149    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 17:58:31.581702 ip-10-0-141-215 kubenswrapper[2575]: I0708 17:58:31.581678    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:00:00.157151 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.157114    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:00:00.160409 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.160392    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:00:00.179551 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.179519    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:00:00.281562 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.281527    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slz77\" (UniqueName: \"kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77\") pod \"maas-api-key-cleanup-29725560-r2k8n\" (UID: \"675f90f1-bc05-4c8b-96e0-cda9d8609a30\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:00:00.382177 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.382136    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slz77\" (UniqueName: \"kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77\") pod \"maas-api-key-cleanup-29725560-r2k8n\" (UID: \"675f90f1-bc05-4c8b-96e0-cda9d8609a30\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:00:00.392332 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.392305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slz77\" (UniqueName: \"kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77\") pod \"maas-api-key-cleanup-29725560-r2k8n\" (UID: \"675f90f1-bc05-4c8b-96e0-cda9d8609a30\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:00:00.470742 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.470652    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:00:00.603510 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.603480    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:00:00.606184 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:00:00.606156    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675f90f1_bc05_4c8b_96e0_cda9d8609a30.slice/crio-17b5eb12e9981ff8ab723063290d0a2747e0083a955aaa97606685bc2c8a98f8 WatchSource:0}: Error finding container 17b5eb12e9981ff8ab723063290d0a2747e0083a955aaa97606685bc2c8a98f8: Status 404 returned error can't find the container with id 17b5eb12e9981ff8ab723063290d0a2747e0083a955aaa97606685bc2c8a98f8
Jul 08 18:00:00.607908 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:00.607889    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:00:01.178709 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:01.178673    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" event={"ID":"675f90f1-bc05-4c8b-96e0-cda9d8609a30","Type":"ContainerStarted","Data":"17b5eb12e9981ff8ab723063290d0a2747e0083a955aaa97606685bc2c8a98f8"}
Jul 08 18:00:04.194537 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:04.194499    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" event={"ID":"675f90f1-bc05-4c8b-96e0-cda9d8609a30","Type":"ContainerStarted","Data":"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"}
Jul 08 18:00:04.213572 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:00:04.213519    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" podStartSLOduration=1.389330373 podStartE2EDuration="4.213500254s" totalImagesPullingTime="2.824169881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:00:04.211882738 +0000 UTC m=+1593.078412778" watchObservedRunningTime="2026-07-08 18:00:04.213500254 +0000 UTC m=+1593.080030296"
Jul 08 18:01:00.013724 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:00.013627    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:01:00.014280 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:00.013918    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" podUID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" containerName="cleanup" containerID="cri-o://f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d" gracePeriod=30
Jul 08 18:01:30.201700 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.201677    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:01:30.256506 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.256474    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slz77\" (UniqueName: \"kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77\") pod \"675f90f1-bc05-4c8b-96e0-cda9d8609a30\" (UID: \"675f90f1-bc05-4c8b-96e0-cda9d8609a30\") "
Jul 08 18:01:30.258557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.258535    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77" (OuterVolumeSpecName: "kube-api-access-slz77") pod "675f90f1-bc05-4c8b-96e0-cda9d8609a30" (UID: "675f90f1-bc05-4c8b-96e0-cda9d8609a30"). InnerVolumeSpecName "kube-api-access-slz77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:01:30.357669 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.357586    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slz77\" (UniqueName: \"kubernetes.io/projected/675f90f1-bc05-4c8b-96e0-cda9d8609a30-kube-api-access-slz77\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:01:30.601823 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.601781    2575 generic.go:356] "Generic (PLEG): container finished" podID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" containerID="f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d" exitCode=137
Jul 08 18:01:30.601823 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.601823    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"
Jul 08 18:01:30.601823 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.601829    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" event={"ID":"675f90f1-bc05-4c8b-96e0-cda9d8609a30","Type":"ContainerDied","Data":"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"}
Jul 08 18:01:30.602096 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.601871    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n" event={"ID":"675f90f1-bc05-4c8b-96e0-cda9d8609a30","Type":"ContainerDied","Data":"17b5eb12e9981ff8ab723063290d0a2747e0083a955aaa97606685bc2c8a98f8"}
Jul 08 18:01:30.602096 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.601896    2575 scope.go:117] "RemoveContainer" containerID="f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"
Jul 08 18:01:30.611084 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.611066    2575 scope.go:117] "RemoveContainer" containerID="f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"
Jul 08 18:01:30.611328 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:01:30.611308    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d\": container with ID starting with f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d not found: ID does not exist" containerID="f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"
Jul 08 18:01:30.611374 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.611337    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d"} err="failed to get container status \"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d\": rpc error: code = NotFound desc = could not find container \"f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d\": container with ID starting with f272814addcba021740500a3433648c22bb01c8efc88365beb0f9a4733518b3d not found: ID does not exist"
Jul 08 18:01:30.626449 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.626407    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:01:30.631830 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:30.631810    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725560-r2k8n"]
Jul 08 18:01:31.602374 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:01:31.602336    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" path="/var/lib/kubelet/pods/675f90f1-bc05-4c8b-96e0-cda9d8609a30/volumes"
Jul 08 18:03:31.604798 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:03:31.604768    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:03:31.610483 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:03:31.610460    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:04:39.168821 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.168784    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:39.169332 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.169292    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" containerName="cleanup"
Jul 08 18:04:39.169332 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.169313    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" containerName="cleanup"
Jul 08 18:04:39.169463 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.169438    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="675f90f1-bc05-4c8b-96e0-cda9d8609a30" containerName="cleanup"
Jul 08 18:04:39.172743 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.172722    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.175781 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.175758    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-32643458-serving-cert\""
Jul 08 18:04:39.191638 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.191614    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:39.261165 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.261129    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.261393 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.261192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.261393 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.261249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77xw5\" (UniqueName: \"kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.361785 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.361748    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.361982 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.361823    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77xw5\" (UniqueName: \"kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.361982 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.361870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.362573 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.362551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.364339 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.364319    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.371240 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.371219    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77xw5\" (UniqueName: \"kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5\") pod \"maas-api-e2e-ait-32643458-645dff8476-8cxzd\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.482993 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.482899    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:39.636883 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:39.636851    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:39.639640 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:04:39.639615    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a39b852_c20c_495e_b6ca_b5f0dc514da8.slice/crio-704971feec7aea1702c0b7a7be0c5463f69d7c014573b965026ae7abda61088a WatchSource:0}: Error finding container 704971feec7aea1702c0b7a7be0c5463f69d7c014573b965026ae7abda61088a: Status 404 returned error can't find the container with id 704971feec7aea1702c0b7a7be0c5463f69d7c014573b965026ae7abda61088a
Jul 08 18:04:40.460433 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:40.460391    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" event={"ID":"7a39b852-c20c-495e-b6ca-b5f0dc514da8","Type":"ContainerStarted","Data":"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"}
Jul 08 18:04:40.460862 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:40.460466    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:40.460862 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:40.460485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" event={"ID":"7a39b852-c20c-495e-b6ca-b5f0dc514da8","Type":"ContainerStarted","Data":"704971feec7aea1702c0b7a7be0c5463f69d7c014573b965026ae7abda61088a"}
Jul 08 18:04:44.613887 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:44.613824    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" podStartSLOduration=4.978992153 podStartE2EDuration="5.61380215s" totalImagesPullingTime="634.809997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:40.479222152 +0000 UTC m=+1869.345752194" watchObservedRunningTime="2026-07-08 18:04:44.61380215 +0000 UTC m=+1873.480332191"
Jul 08 18:04:44.615381 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:44.615357    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:44.615599 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:44.615576    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" podUID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" containerName="maas-api" containerID="cri-o://2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b" gracePeriod=30
Jul 08 18:04:44.868173 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:44.868116    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:45.013627 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.013593    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls\") pod \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") "
Jul 08 18:04:45.013801 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.013717    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca\") pod \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") "
Jul 08 18:04:45.013801 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.013760    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77xw5\" (UniqueName: \"kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5\") pod \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\" (UID: \"7a39b852-c20c-495e-b6ca-b5f0dc514da8\") "
Jul 08 18:04:45.014103 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.014077    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a39b852-c20c-495e-b6ca-b5f0dc514da8" (UID: "7a39b852-c20c-495e-b6ca-b5f0dc514da8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:04:45.015815 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.015784    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5" (OuterVolumeSpecName: "kube-api-access-77xw5") pod "7a39b852-c20c-495e-b6ca-b5f0dc514da8" (UID: "7a39b852-c20c-495e-b6ca-b5f0dc514da8"). InnerVolumeSpecName "kube-api-access-77xw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:04:45.015917 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.015868    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a39b852-c20c-495e-b6ca-b5f0dc514da8" (UID: "7a39b852-c20c-495e-b6ca-b5f0dc514da8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:04:45.114379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.114343    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a39b852-c20c-495e-b6ca-b5f0dc514da8-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:45.114379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.114372    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77xw5\" (UniqueName: \"kubernetes.io/projected/7a39b852-c20c-495e-b6ca-b5f0dc514da8-kube-api-access-77xw5\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:45.114379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.114382    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a39b852-c20c-495e-b6ca-b5f0dc514da8-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:45.484944 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.484897    2575 generic.go:356] "Generic (PLEG): container finished" podID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" containerID="2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b" exitCode=0
Jul 08 18:04:45.485117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.485002    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"
Jul 08 18:04:45.485117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.485031    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" event={"ID":"7a39b852-c20c-495e-b6ca-b5f0dc514da8","Type":"ContainerDied","Data":"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"}
Jul 08 18:04:45.485117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.485082    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd" event={"ID":"7a39b852-c20c-495e-b6ca-b5f0dc514da8","Type":"ContainerDied","Data":"704971feec7aea1702c0b7a7be0c5463f69d7c014573b965026ae7abda61088a"}
Jul 08 18:04:45.485117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.485107    2575 scope.go:117] "RemoveContainer" containerID="2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"
Jul 08 18:04:45.495344 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.495325    2575 scope.go:117] "RemoveContainer" containerID="2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"
Jul 08 18:04:45.495676 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:04:45.495652    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b\": container with ID starting with 2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b not found: ID does not exist" containerID="2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"
Jul 08 18:04:45.495759 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.495689    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b"} err="failed to get container status \"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b\": rpc error: code = NotFound desc = could not find container \"2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b\": container with ID starting with 2e8a8423009f37fac102219e0681e2a61f0f23ea971800a78cee863d3796da8b not found: ID does not exist"
Jul 08 18:04:45.508443 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.508406    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:45.512174 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.512154    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-32643458-645dff8476-8cxzd"]
Jul 08 18:04:45.602462 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:45.602433    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" path="/var/lib/kubelet/pods/7a39b852-c20c-495e-b6ca-b5f0dc514da8/volumes"
Jul 08 18:04:52.562464 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.562408    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:52.562966 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.562943    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" containerName="maas-api"
Jul 08 18:04:52.562966 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.562963    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" containerName="maas-api"
Jul 08 18:04:52.563077 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.563049    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a39b852-c20c-495e-b6ca-b5f0dc514da8" containerName="maas-api"
Jul 08 18:04:52.567403 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.567379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.570058 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.570032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-ddc77540-serving-cert\""
Jul 08 18:04:52.572548 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.572521    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlmpf\" (UniqueName: \"kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.572648 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.572575    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.572648 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.572628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.578029 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.578006    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:52.673669 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.673629    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlmpf\" (UniqueName: \"kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.673878 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.673679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.673878 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.673711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.673878 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:04:52.673803    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-serving-cert: secret "maas-api-e2e-migrate-ddc77540-serving-cert" not found
Jul 08 18:04:52.673878 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:04:52.673881    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls podName:f220869a-97a6-432d-bfa2-39a4008ae3e9 nodeName:}" failed. No retries permitted until 2026-07-08 18:04:53.173857244 +0000 UTC m=+1882.040387272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls") pod "maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" (UID: "f220869a-97a6-432d-bfa2-39a4008ae3e9") : secret "maas-api-e2e-migrate-ddc77540-serving-cert" not found
Jul 08 18:04:52.674332 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.674309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:52.682561 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:52.682535    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlmpf\" (UniqueName: \"kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:53.178690 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:53.178599    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:53.181247 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:53.181220    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") pod \"maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:53.479539 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:53.479446    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:53.618439 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:53.618380    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:53.621516 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:04:53.621490    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf220869a_97a6_432d_bfa2_39a4008ae3e9.slice/crio-86ca07bccc1ed0c08cc92b65fb94b4a88cb44d8ceda67b3d2249d8d62795b34a WatchSource:0}: Error finding container 86ca07bccc1ed0c08cc92b65fb94b4a88cb44d8ceda67b3d2249d8d62795b34a: Status 404 returned error can't find the container with id 86ca07bccc1ed0c08cc92b65fb94b4a88cb44d8ceda67b3d2249d8d62795b34a
Jul 08 18:04:54.537315 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:54.537278    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" event={"ID":"f220869a-97a6-432d-bfa2-39a4008ae3e9","Type":"ContainerStarted","Data":"7ab29e88e7a0efcb128167d3b4d796e74c1818de3e6beb32af45627b089b4886"}
Jul 08 18:04:54.537531 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:54.537335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" event={"ID":"f220869a-97a6-432d-bfa2-39a4008ae3e9","Type":"ContainerStarted","Data":"86ca07bccc1ed0c08cc92b65fb94b4a88cb44d8ceda67b3d2249d8d62795b34a"}
Jul 08 18:04:54.537531 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:54.537385    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:54.555722 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:54.555670    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" podStartSLOduration=1.744187369 podStartE2EDuration="2.555652837s" totalImagesPullingTime="811.465468ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:54.553910279 +0000 UTC m=+1883.420440342" watchObservedRunningTime="2026-07-08 18:04:54.555652837 +0000 UTC m=+1883.422182879"
Jul 08 18:04:57.411556 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.411522    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:57.412050 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.411820    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" podUID="f220869a-97a6-432d-bfa2-39a4008ae3e9" containerName="maas-api" containerID="cri-o://7ab29e88e7a0efcb128167d3b4d796e74c1818de3e6beb32af45627b089b4886" gracePeriod=30
Jul 08 18:04:57.552866 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.552831    2575 generic.go:356] "Generic (PLEG): container finished" podID="f220869a-97a6-432d-bfa2-39a4008ae3e9" containerID="7ab29e88e7a0efcb128167d3b4d796e74c1818de3e6beb32af45627b089b4886" exitCode=0
Jul 08 18:04:57.553096 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.552920    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" event={"ID":"f220869a-97a6-432d-bfa2-39a4008ae3e9","Type":"ContainerDied","Data":"7ab29e88e7a0efcb128167d3b4d796e74c1818de3e6beb32af45627b089b4886"}
Jul 08 18:04:57.665631 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.665559    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:57.717076 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.717042    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlmpf\" (UniqueName: \"kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf\") pod \"f220869a-97a6-432d-bfa2-39a4008ae3e9\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") "
Jul 08 18:04:57.717270 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.717111    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca\") pod \"f220869a-97a6-432d-bfa2-39a4008ae3e9\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") "
Jul 08 18:04:57.717270 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.717140    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") pod \"f220869a-97a6-432d-bfa2-39a4008ae3e9\" (UID: \"f220869a-97a6-432d-bfa2-39a4008ae3e9\") "
Jul 08 18:04:57.717582 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.717551    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f220869a-97a6-432d-bfa2-39a4008ae3e9" (UID: "f220869a-97a6-432d-bfa2-39a4008ae3e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:04:57.719234 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.719203    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf" (OuterVolumeSpecName: "kube-api-access-dlmpf") pod "f220869a-97a6-432d-bfa2-39a4008ae3e9" (UID: "f220869a-97a6-432d-bfa2-39a4008ae3e9"). InnerVolumeSpecName "kube-api-access-dlmpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:04:57.719305 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.719284    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f220869a-97a6-432d-bfa2-39a4008ae3e9" (UID: "f220869a-97a6-432d-bfa2-39a4008ae3e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:04:57.817944 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.817903    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f220869a-97a6-432d-bfa2-39a4008ae3e9-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:57.817944 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.817937    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlmpf\" (UniqueName: \"kubernetes.io/projected/f220869a-97a6-432d-bfa2-39a4008ae3e9-kube-api-access-dlmpf\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:57.817944 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:57.817947    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f220869a-97a6-432d-bfa2-39a4008ae3e9-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:04:58.558633 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:58.558595    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8" event={"ID":"f220869a-97a6-432d-bfa2-39a4008ae3e9","Type":"ContainerDied","Data":"86ca07bccc1ed0c08cc92b65fb94b4a88cb44d8ceda67b3d2249d8d62795b34a"}
Jul 08 18:04:58.559069 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:58.558654    2575 scope.go:117] "RemoveContainer" containerID="7ab29e88e7a0efcb128167d3b4d796e74c1818de3e6beb32af45627b089b4886"
Jul 08 18:04:58.559069 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:58.558603    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"
Jul 08 18:04:58.584536 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:58.584507    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:58.587386 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:58.587359    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ddc77540-687dfc64bb-b88l8"]
Jul 08 18:04:59.602374 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:04:59.602340    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f220869a-97a6-432d-bfa2-39a4008ae3e9" path="/var/lib/kubelet/pods/f220869a-97a6-432d-bfa2-39a4008ae3e9/volumes"
Jul 08 18:05:05.603215 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.603185    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:05.603629 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.603535    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f220869a-97a6-432d-bfa2-39a4008ae3e9" containerName="maas-api"
Jul 08 18:05:05.603629 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.603547    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="f220869a-97a6-432d-bfa2-39a4008ae3e9" containerName="maas-api"
Jul 08 18:05:05.603629 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.603614    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="f220869a-97a6-432d-bfa2-39a4008ae3e9" containerName="maas-api"
Jul 08 18:05:05.606555 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.606537    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.610144 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.610122    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-05d0f1bc-serving-cert\""
Jul 08 18:05:05.616271 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.616247    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:05.686254 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.686219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.686254 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.686253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wwbj\" (UniqueName: \"kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.686472 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.686309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.786909 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.786872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.787076 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.786934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.787135 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.787108    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wwbj\" (UniqueName: \"kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.787663 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.787634    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.789358 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.789334    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.799914 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.799888    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wwbj\" (UniqueName: \"kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj\") pod \"maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:05.918005 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:05.917964    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:06.056961 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.056935    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:06.059699 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:05:06.059663    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb99b89_0571_416a_8c9d_c632a5a07b7d.slice/crio-dd23cd2470a32870b953c0d22199853e252f620f664a66f5a107961c3127f489 WatchSource:0}: Error finding container dd23cd2470a32870b953c0d22199853e252f620f664a66f5a107961c3127f489: Status 404 returned error can't find the container with id dd23cd2470a32870b953c0d22199853e252f620f664a66f5a107961c3127f489
Jul 08 18:05:06.061387 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.061370    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:05:06.601211 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.601178    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" event={"ID":"feb99b89-0571-416a-8c9d-c632a5a07b7d","Type":"ContainerStarted","Data":"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"}
Jul 08 18:05:06.601378 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.601229    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" event={"ID":"feb99b89-0571-416a-8c9d-c632a5a07b7d","Type":"ContainerStarted","Data":"dd23cd2470a32870b953c0d22199853e252f620f664a66f5a107961c3127f489"}
Jul 08 18:05:06.601378 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.601250    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:06.624097 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:06.624044    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" podStartSLOduration=1.279325624 podStartE2EDuration="1.624025974s" totalImagesPullingTime="344.70035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:06.621911253 +0000 UTC m=+1895.488441296" watchObservedRunningTime="2026-07-08 18:05:06.624025974 +0000 UTC m=+1895.490556015"
Jul 08 18:05:11.065016 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.064974    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:11.065550 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.065157    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" podUID="feb99b89-0571-416a-8c9d-c632a5a07b7d" containerName="maas-api" containerID="cri-o://118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651" gracePeriod=30
Jul 08 18:05:11.071678 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.071649    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:11.318013 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.317945    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:11.436934 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.436894    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wwbj\" (UniqueName: \"kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj\") pod \"feb99b89-0571-416a-8c9d-c632a5a07b7d\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") "
Jul 08 18:05:11.437117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.436946    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls\") pod \"feb99b89-0571-416a-8c9d-c632a5a07b7d\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") "
Jul 08 18:05:11.437117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.436964    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca\") pod \"feb99b89-0571-416a-8c9d-c632a5a07b7d\" (UID: \"feb99b89-0571-416a-8c9d-c632a5a07b7d\") "
Jul 08 18:05:11.437372 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.437346    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "feb99b89-0571-416a-8c9d-c632a5a07b7d" (UID: "feb99b89-0571-416a-8c9d-c632a5a07b7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:05:11.439028 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.439001    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "feb99b89-0571-416a-8c9d-c632a5a07b7d" (UID: "feb99b89-0571-416a-8c9d-c632a5a07b7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:05:11.439129 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.439074    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj" (OuterVolumeSpecName: "kube-api-access-4wwbj") pod "feb99b89-0571-416a-8c9d-c632a5a07b7d" (UID: "feb99b89-0571-416a-8c9d-c632a5a07b7d"). InnerVolumeSpecName "kube-api-access-4wwbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:05:11.538493 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.538452    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wwbj\" (UniqueName: \"kubernetes.io/projected/feb99b89-0571-416a-8c9d-c632a5a07b7d-kube-api-access-4wwbj\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:11.538493 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.538495    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/feb99b89-0571-416a-8c9d-c632a5a07b7d-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:11.538694 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.538509    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/feb99b89-0571-416a-8c9d-c632a5a07b7d-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:11.625656 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.625616    2575 generic.go:356] "Generic (PLEG): container finished" podID="feb99b89-0571-416a-8c9d-c632a5a07b7d" containerID="118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651" exitCode=0
Jul 08 18:05:11.625656 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.625663    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"
Jul 08 18:05:11.625861 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.625672    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" event={"ID":"feb99b89-0571-416a-8c9d-c632a5a07b7d","Type":"ContainerDied","Data":"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"}
Jul 08 18:05:11.625861 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.625727    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh" event={"ID":"feb99b89-0571-416a-8c9d-c632a5a07b7d","Type":"ContainerDied","Data":"dd23cd2470a32870b953c0d22199853e252f620f664a66f5a107961c3127f489"}
Jul 08 18:05:11.625861 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.625757    2575 scope.go:117] "RemoveContainer" containerID="118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"
Jul 08 18:05:11.634130 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.634109    2575 scope.go:117] "RemoveContainer" containerID="118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"
Jul 08 18:05:11.634381 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:05:11.634364    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651\": container with ID starting with 118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651 not found: ID does not exist" containerID="118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"
Jul 08 18:05:11.634466 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.634388    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651"} err="failed to get container status \"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651\": rpc error: code = NotFound desc = could not find container \"118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651\": container with ID starting with 118169fa115aa073119a9c8c4c66e90836e271fbadcc35e2ad3bf07cbe267651 not found: ID does not exist"
Jul 08 18:05:11.641431 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.641387    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:11.645343 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:11.645318    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-05d0f1bc-5dcdf4b584-fq5bh"]
Jul 08 18:05:13.602310 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:13.602273    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb99b89-0571-416a-8c9d-c632a5a07b7d" path="/var/lib/kubelet/pods/feb99b89-0571-416a-8c9d-c632a5a07b7d/volumes"
Jul 08 18:05:24.856083 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.856051    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:24.856486 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.856408    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb99b89-0571-416a-8c9d-c632a5a07b7d" containerName="maas-api"
Jul 08 18:05:24.856486 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.856444    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb99b89-0571-416a-8c9d-c632a5a07b7d" containerName="maas-api"
Jul 08 18:05:24.856570 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.856497    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb99b89-0571-416a-8c9d-c632a5a07b7d" containerName="maas-api"
Jul 08 18:05:24.860521 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.860505    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:24.864393 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.864369    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-fe39ee72-serving-cert\""
Jul 08 18:05:24.880072 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.880040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:24.957428 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.957387    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:24.957603 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.957455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:24.957603 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:24.957525    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtrks\" (UniqueName: \"kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.058675 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.058638    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtrks\" (UniqueName: \"kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.058876 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.058692    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.058876 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:05:25.058783    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-serving-cert: secret "maas-api-e2e-derive-fe39ee72-serving-cert" not found
Jul 08 18:05:25.058876 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:05:25.058840    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls podName:1063ab96-1e45-4be5-9229-6e468d6a8122 nodeName:}" failed. No retries permitted until 2026-07-08 18:05:25.558824654 +0000 UTC m=+1914.425354674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls") pod "maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" (UID: "1063ab96-1e45-4be5-9229-6e468d6a8122") : secret "maas-api-e2e-derive-fe39ee72-serving-cert" not found
Jul 08 18:05:25.058876 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.058839    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.059516 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.059498    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.068643 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.068621    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtrks\" (UniqueName: \"kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.564461 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.564388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.567024 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.566999    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") pod \"maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.770718 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.770680    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:25.916939 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:25.916873    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:25.919308 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:05:25.919280    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1063ab96_1e45_4be5_9229_6e468d6a8122.slice/crio-2765b9463f6db29ebd486de027bef8a05225bcf9fa08e955f7361fb520c414e9 WatchSource:0}: Error finding container 2765b9463f6db29ebd486de027bef8a05225bcf9fa08e955f7361fb520c414e9: Status 404 returned error can't find the container with id 2765b9463f6db29ebd486de027bef8a05225bcf9fa08e955f7361fb520c414e9
Jul 08 18:05:26.697005 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:26.696967    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" event={"ID":"1063ab96-1e45-4be5-9229-6e468d6a8122","Type":"ContainerStarted","Data":"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"}
Jul 08 18:05:26.697175 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:26.697120    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:26.697175 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:26.697155    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" event={"ID":"1063ab96-1e45-4be5-9229-6e468d6a8122","Type":"ContainerStarted","Data":"2765b9463f6db29ebd486de027bef8a05225bcf9fa08e955f7361fb520c414e9"}
Jul 08 18:05:26.717989 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:26.717944    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" podStartSLOduration=2.154555106 podStartE2EDuration="2.717929295s" totalImagesPullingTime="563.374189ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:26.716138269 +0000 UTC m=+1915.582668344" watchObservedRunningTime="2026-07-08 18:05:26.717929295 +0000 UTC m=+1915.584459337"
Jul 08 18:05:29.391486 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.391451    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:29.391927 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.391637    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" podUID="1063ab96-1e45-4be5-9229-6e468d6a8122" containerName="maas-api" containerID="cri-o://f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8" gracePeriod=30
Jul 08 18:05:29.647889 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.647827    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:29.711091 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.711052    2575 generic.go:356] "Generic (PLEG): container finished" podID="1063ab96-1e45-4be5-9229-6e468d6a8122" containerID="f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8" exitCode=0
Jul 08 18:05:29.711091 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.711096    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"
Jul 08 18:05:29.711329 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.711104    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" event={"ID":"1063ab96-1e45-4be5-9229-6e468d6a8122","Type":"ContainerDied","Data":"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"}
Jul 08 18:05:29.711329 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.711161    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh" event={"ID":"1063ab96-1e45-4be5-9229-6e468d6a8122","Type":"ContainerDied","Data":"2765b9463f6db29ebd486de027bef8a05225bcf9fa08e955f7361fb520c414e9"}
Jul 08 18:05:29.711329 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.711190    2575 scope.go:117] "RemoveContainer" containerID="f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"
Jul 08 18:05:29.719298 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.719279    2575 scope.go:117] "RemoveContainer" containerID="f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"
Jul 08 18:05:29.719589 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:05:29.719570    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8\": container with ID starting with f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8 not found: ID does not exist" containerID="f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"
Jul 08 18:05:29.719641 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.719599    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8"} err="failed to get container status \"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8\": rpc error: code = NotFound desc = could not find container \"f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8\": container with ID starting with f7ac4865136b6a60d93479dc0af79d4bfd916f4f1eeb7f3ccf13a6e1d68018d8 not found: ID does not exist"
Jul 08 18:05:29.802914 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.802875    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca\") pod \"1063ab96-1e45-4be5-9229-6e468d6a8122\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") "
Jul 08 18:05:29.802914 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.802916    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") pod \"1063ab96-1e45-4be5-9229-6e468d6a8122\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") "
Jul 08 18:05:29.803127 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.802950    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtrks\" (UniqueName: \"kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks\") pod \"1063ab96-1e45-4be5-9229-6e468d6a8122\" (UID: \"1063ab96-1e45-4be5-9229-6e468d6a8122\") "
Jul 08 18:05:29.803292 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.803268    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1063ab96-1e45-4be5-9229-6e468d6a8122" (UID: "1063ab96-1e45-4be5-9229-6e468d6a8122"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:05:29.805107 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.805085    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1063ab96-1e45-4be5-9229-6e468d6a8122" (UID: "1063ab96-1e45-4be5-9229-6e468d6a8122"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:05:29.805107 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.805093    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks" (OuterVolumeSpecName: "kube-api-access-vtrks") pod "1063ab96-1e45-4be5-9229-6e468d6a8122" (UID: "1063ab96-1e45-4be5-9229-6e468d6a8122"). InnerVolumeSpecName "kube-api-access-vtrks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:05:29.904111 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.904015    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1063ab96-1e45-4be5-9229-6e468d6a8122-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:29.904111 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.904046    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1063ab96-1e45-4be5-9229-6e468d6a8122-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:29.904111 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:29.904061    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtrks\" (UniqueName: \"kubernetes.io/projected/1063ab96-1e45-4be5-9229-6e468d6a8122-kube-api-access-vtrks\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:05:30.033226 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:30.033193    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:30.038319 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:30.038285    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-fe39ee72-777964bcb8-sw7rh"]
Jul 08 18:05:31.609942 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:05:31.609898    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1063ab96-1e45-4be5-9229-6e468d6a8122" path="/var/lib/kubelet/pods/1063ab96-1e45-4be5-9229-6e468d6a8122/volumes"
Jul 08 18:07:21.721881 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.721845    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:21.724328 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.722359    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1063ab96-1e45-4be5-9229-6e468d6a8122" containerName="maas-api"
Jul 08 18:07:21.724328 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.722375    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1063ab96-1e45-4be5-9229-6e468d6a8122" containerName="maas-api"
Jul 08 18:07:21.724328 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.722467    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1063ab96-1e45-4be5-9229-6e468d6a8122" containerName="maas-api"
Jul 08 18:07:21.725323 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.725306    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.727792 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.727771    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a1cf05a8-serving-cert\""
Jul 08 18:07:21.738315 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.738295    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:21.852595 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.852550    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czjlr\" (UniqueName: \"kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.852781 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.852625    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.852781 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.852685    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.953349 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.953310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czjlr\" (UniqueName: \"kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.953349 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.953355    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.953592 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.953384    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.953592 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:07:21.953514    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-serving-cert: secret "maas-api-e2e-mt-a1cf05a8-serving-cert" not found
Jul 08 18:07:21.953680 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:07:21.953593    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls podName:556fbe25-1ec8-4b22-aac7-66742aaaf5a8 nodeName:}" failed. No retries permitted until 2026-07-08 18:07:22.453574116 +0000 UTC m=+2031.320104136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls") pod "maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" (UID: "556fbe25-1ec8-4b22-aac7-66742aaaf5a8") : secret "maas-api-e2e-mt-a1cf05a8-serving-cert" not found
Jul 08 18:07:21.954057 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.954037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:21.962835 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:21.962802    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czjlr\" (UniqueName: \"kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:22.456473 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:22.456432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:22.458885 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:22.458857    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") pod \"maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:22.636465 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:22.636406    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:22.774444 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:22.774403    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:22.776596 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:07:22.776563    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556fbe25_1ec8_4b22_aac7_66742aaaf5a8.slice/crio-567f01283ebae87f4eb45714de0938964323b7329303bdc522706c8cdc6f0663 WatchSource:0}: Error finding container 567f01283ebae87f4eb45714de0938964323b7329303bdc522706c8cdc6f0663: Status 404 returned error can't find the container with id 567f01283ebae87f4eb45714de0938964323b7329303bdc522706c8cdc6f0663
Jul 08 18:07:23.215219 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:23.215181    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" event={"ID":"556fbe25-1ec8-4b22-aac7-66742aaaf5a8","Type":"ContainerStarted","Data":"567f01283ebae87f4eb45714de0938964323b7329303bdc522706c8cdc6f0663"}
Jul 08 18:07:26.229940 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:26.229917    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" event={"ID":"556fbe25-1ec8-4b22-aac7-66742aaaf5a8","Type":"ContainerStarted","Data":"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"}
Jul 08 18:07:26.230258 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:26.230052    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:26.251591 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:26.251543    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" podStartSLOduration=1.865164015 podStartE2EDuration="5.251524523s" totalImagesPullingTime="3.386360508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:07:26.249563159 +0000 UTC m=+2035.116093201" watchObservedRunningTime="2026-07-08 18:07:26.251524523 +0000 UTC m=+2035.118054565"
Jul 08 18:07:32.239579 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:32.239550    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:34.457202 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.457160    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:34.457708 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.457387    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" podUID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" containerName="maas-api" containerID="cri-o://6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e" gracePeriod=30
Jul 08 18:07:34.703700 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.703673    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:34.863342 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.863313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czjlr\" (UniqueName: \"kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr\") pod \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") "
Jul 08 18:07:34.863522 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.863351    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca\") pod \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") "
Jul 08 18:07:34.863579 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.863514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") pod \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\" (UID: \"556fbe25-1ec8-4b22-aac7-66742aaaf5a8\") "
Jul 08 18:07:34.863711 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.863693    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "556fbe25-1ec8-4b22-aac7-66742aaaf5a8" (UID: "556fbe25-1ec8-4b22-aac7-66742aaaf5a8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:07:34.863859 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.863839    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:07:34.865451 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.865410    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr" (OuterVolumeSpecName: "kube-api-access-czjlr") pod "556fbe25-1ec8-4b22-aac7-66742aaaf5a8" (UID: "556fbe25-1ec8-4b22-aac7-66742aaaf5a8"). InnerVolumeSpecName "kube-api-access-czjlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:07:34.865570 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.865518    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "556fbe25-1ec8-4b22-aac7-66742aaaf5a8" (UID: "556fbe25-1ec8-4b22-aac7-66742aaaf5a8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:07:34.964481 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.964453    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:07:34.964481 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:34.964478    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czjlr\" (UniqueName: \"kubernetes.io/projected/556fbe25-1ec8-4b22-aac7-66742aaaf5a8-kube-api-access-czjlr\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:07:35.271075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.270986    2575 generic.go:356] "Generic (PLEG): container finished" podID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" containerID="6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e" exitCode=0
Jul 08 18:07:35.271075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.271030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" event={"ID":"556fbe25-1ec8-4b22-aac7-66742aaaf5a8","Type":"ContainerDied","Data":"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"}
Jul 08 18:07:35.271075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.271033    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"
Jul 08 18:07:35.271320 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.271110    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz" event={"ID":"556fbe25-1ec8-4b22-aac7-66742aaaf5a8","Type":"ContainerDied","Data":"567f01283ebae87f4eb45714de0938964323b7329303bdc522706c8cdc6f0663"}
Jul 08 18:07:35.271320 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.271133    2575 scope.go:117] "RemoveContainer" containerID="6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"
Jul 08 18:07:35.279883 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.279867    2575 scope.go:117] "RemoveContainer" containerID="6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"
Jul 08 18:07:35.280097 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:07:35.280079    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e\": container with ID starting with 6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e not found: ID does not exist" containerID="6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"
Jul 08 18:07:35.280145 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.280106    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e"} err="failed to get container status \"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e\": rpc error: code = NotFound desc = could not find container \"6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e\": container with ID starting with 6eadf3edc27fb5280028a3ce8a7327420adf288fd7a992940fb60c7ca32dd98e not found: ID does not exist"
Jul 08 18:07:35.292454 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.292410    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:35.296705 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.296685    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1cf05a8-5795bbbcf5-2k4qz"]
Jul 08 18:07:35.601784 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:07:35.601705    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" path="/var/lib/kubelet/pods/556fbe25-1ec8-4b22-aac7-66742aaaf5a8/volumes"
Jul 08 18:08:05.857000 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.856921    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:05.857443 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.857313    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" containerName="maas-api"
Jul 08 18:08:05.857443 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.857328    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" containerName="maas-api"
Jul 08 18:08:05.857443 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.857386    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="556fbe25-1ec8-4b22-aac7-66742aaaf5a8" containerName="maas-api"
Jul 08 18:08:05.860252 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.860236    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:05.863007 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.862983    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-253d53e7-serving-cert\""
Jul 08 18:08:05.872565 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.872541    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:05.924804 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.924763    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:05.924986 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.924834    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfvnp\" (UniqueName: \"kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:05.924986 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:05.924876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.026242 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.026211    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfvnp\" (UniqueName: \"kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.026452 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.026257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.026452 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.026290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.026984 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.026963    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.028719 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.028696    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.036437 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.036385    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfvnp\" (UniqueName: \"kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp\") pod \"maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.172496 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.172463    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:06.307295 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.307264    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:06.310059 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:08:06.310029    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc54f63bb_0d47_4496_b5d6_6e1678ba3d40.slice/crio-dd578b440477ae9e1eaebd353b40ab4f5c929df5e64d40869f165fd578ad0b3b WatchSource:0}: Error finding container dd578b440477ae9e1eaebd353b40ab4f5c929df5e64d40869f165fd578ad0b3b: Status 404 returned error can't find the container with id dd578b440477ae9e1eaebd353b40ab4f5c929df5e64d40869f165fd578ad0b3b
Jul 08 18:08:06.412676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:06.412644    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" event={"ID":"c54f63bb-0d47-4496-b5d6-6e1678ba3d40","Type":"ContainerStarted","Data":"dd578b440477ae9e1eaebd353b40ab4f5c929df5e64d40869f165fd578ad0b3b"}
Jul 08 18:08:07.418790 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:07.418752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" event={"ID":"c54f63bb-0d47-4496-b5d6-6e1678ba3d40","Type":"ContainerStarted","Data":"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"}
Jul 08 18:08:07.419295 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:07.418865    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:07.442955 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:07.442904    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" podStartSLOduration=2.034474196 podStartE2EDuration="2.442888479s" totalImagesPullingTime="408.414283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:08:07.438015628 +0000 UTC m=+2076.304545670" watchObservedRunningTime="2026-07-08 18:08:07.442888479 +0000 UTC m=+2076.309418520"
Jul 08 18:08:13.429257 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.429226    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:13.892452 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.892401    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:08:13.895877 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.895855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.899020 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.898998    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-253d53e7\"/\"e2e-lifecycle-model-253d53e7-kserve-self-signed-certs\""
Jul 08 18:08:13.899724 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.899704    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-253d53e7\"/\"kube-root-ca.crt\""
Jul 08 18:08:13.899901 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.899884    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-253d53e7\"/\"default-dockercfg-w244q\""
Jul 08 18:08:13.899992 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.899958    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-253d53e7\"/\"openshift-service-ca.crt\""
Jul 08 18:08:13.913751 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.913725    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:08:13.998923 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.998889    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.998923 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.998924    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.999170 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.998947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.999170 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.999065    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.999170 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.999093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:13.999170 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:13.999128    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcv7\" (UniqueName: \"kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100506 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100464    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100506 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100506    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcv7\" (UniqueName: \"kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100588    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.100769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100609    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.101002 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100966    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.101063 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.100976    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.101063 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.101037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.102917 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.102894    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.103100 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.103083    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.110773 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.110751    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcv7\" (UniqueName: \"kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7\") pod \"e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") " pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.205235 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.205134    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:14.341861 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.341836    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:08:14.343786 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:08:14.343761    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod385744c6_8d34_45c9_ab18_e174578df7b3.slice/crio-3c999293dd5e21bf8ee3a076f4e1aae488193a4a6e5d6e2db8444c699752e8b9 WatchSource:0}: Error finding container 3c999293dd5e21bf8ee3a076f4e1aae488193a4a6e5d6e2db8444c699752e8b9: Status 404 returned error can't find the container with id 3c999293dd5e21bf8ee3a076f4e1aae488193a4a6e5d6e2db8444c699752e8b9
Jul 08 18:08:14.452100 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.452065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" event={"ID":"385744c6-8d34-45c9-ab18-e174578df7b3","Type":"ContainerStarted","Data":"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"}
Jul 08 18:08:14.452500 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.452112    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" event={"ID":"385744c6-8d34-45c9-ab18-e174578df7b3","Type":"ContainerStarted","Data":"3c999293dd5e21bf8ee3a076f4e1aae488193a4a6e5d6e2db8444c699752e8b9"}
Jul 08 18:08:14.487990 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:14.487879    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" podStartSLOduration=1.487859238 podStartE2EDuration="1.487859238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:08:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:08:14.487257753 +0000 UTC m=+2083.353787821" watchObservedRunningTime="2026-07-08 18:08:14.487859238 +0000 UTC m=+2083.354389282"
Jul 08 18:08:24.205702 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:24.205662    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:24.205702 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:24.205706    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:24.218070 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:24.218045    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:24.512542 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:24.512463    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:31.633987 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:31.633955    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:08:31.640882 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:31.640860    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:08:32.857269 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:32.857236    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:32.857736 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:32.857518    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" podUID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" containerName="maas-api" containerID="cri-o://c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74" gracePeriod=30
Jul 08 18:08:33.099738 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.099713    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:33.169933 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.169899    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca\") pod \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") "
Jul 08 18:08:33.170105 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.169942    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfvnp\" (UniqueName: \"kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp\") pod \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") "
Jul 08 18:08:33.170105 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.169966    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls\") pod \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\" (UID: \"c54f63bb-0d47-4496-b5d6-6e1678ba3d40\") "
Jul 08 18:08:33.170289 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.170268    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c54f63bb-0d47-4496-b5d6-6e1678ba3d40" (UID: "c54f63bb-0d47-4496-b5d6-6e1678ba3d40"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:08:33.172028 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.171996    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp" (OuterVolumeSpecName: "kube-api-access-zfvnp") pod "c54f63bb-0d47-4496-b5d6-6e1678ba3d40" (UID: "c54f63bb-0d47-4496-b5d6-6e1678ba3d40"). InnerVolumeSpecName "kube-api-access-zfvnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:08:33.172145 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.172060    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c54f63bb-0d47-4496-b5d6-6e1678ba3d40" (UID: "c54f63bb-0d47-4496-b5d6-6e1678ba3d40"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:08:33.270565 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.270531    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfvnp\" (UniqueName: \"kubernetes.io/projected/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-kube-api-access-zfvnp\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:33.270565 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.270560    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:33.270565 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.270569    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c54f63bb-0d47-4496-b5d6-6e1678ba3d40-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:33.541634 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.541541    2575 generic.go:356] "Generic (PLEG): container finished" podID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" containerID="c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74" exitCode=0
Jul 08 18:08:33.541634 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.541584    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"
Jul 08 18:08:33.541814 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.541629    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" event={"ID":"c54f63bb-0d47-4496-b5d6-6e1678ba3d40","Type":"ContainerDied","Data":"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"}
Jul 08 18:08:33.541814 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.541683    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9" event={"ID":"c54f63bb-0d47-4496-b5d6-6e1678ba3d40","Type":"ContainerDied","Data":"dd578b440477ae9e1eaebd353b40ab4f5c929df5e64d40869f165fd578ad0b3b"}
Jul 08 18:08:33.541814 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.541706    2575 scope.go:117] "RemoveContainer" containerID="c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"
Jul 08 18:08:33.550707 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.550688    2575 scope.go:117] "RemoveContainer" containerID="c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"
Jul 08 18:08:33.550963 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:08:33.550947    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74\": container with ID starting with c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74 not found: ID does not exist" containerID="c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"
Jul 08 18:08:33.551006 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.550971    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74"} err="failed to get container status \"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74\": rpc error: code = NotFound desc = could not find container \"c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74\": container with ID starting with c84bd7c508bcfba1725c7c0c1407c6c019032d17199be6c80d541046ad6b9b74 not found: ID does not exist"
Jul 08 18:08:33.562656 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.562633    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:33.566895 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.566874    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-253d53e7-764cdc6d6b-jg4c9"]
Jul 08 18:08:33.601724 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:33.601693    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" path="/var/lib/kubelet/pods/c54f63bb-0d47-4496-b5d6-6e1678ba3d40/volumes"
Jul 08 18:08:43.658468 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:43.658436    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:08:58.678234 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.678175    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" podUID="385744c6-8d34-45c9-ab18-e174578df7b3" containerName="main" containerID="cri-o://a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f" gracePeriod=45
Jul 08 18:08:58.934710 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.934645    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:58.986641 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986601    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.986824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986664    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jcv7\" (UniqueName: \"kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.986824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986738    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.986824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986772    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.986824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986812    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.987051 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986842    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs\") pod \"385744c6-8d34-45c9-ab18-e174578df7b3\" (UID: \"385744c6-8d34-45c9-ab18-e174578df7b3\") "
Jul 08 18:08:58.987051 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.986869    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache" (OuterVolumeSpecName: "model-cache") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:08:58.987051 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.987001    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home" (OuterVolumeSpecName: "home") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:08:58.987227 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.987077    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:08:58.987227 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.987119    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:58.987227 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.987131    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:58.989117 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.989057    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:08:58.989233 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.989210    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm" (OuterVolumeSpecName: "dshm") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:08:58.989325 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:58.989308    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7" (OuterVolumeSpecName: "kube-api-access-2jcv7") pod "385744c6-8d34-45c9-ab18-e174578df7b3" (UID: "385744c6-8d34-45c9-ab18-e174578df7b3"). InnerVolumeSpecName "kube-api-access-2jcv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:08:59.088133 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.088098    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jcv7\" (UniqueName: \"kubernetes.io/projected/385744c6-8d34-45c9-ab18-e174578df7b3-kube-api-access-2jcv7\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:59.088133 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.088131    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:59.088133 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.088141    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/385744c6-8d34-45c9-ab18-e174578df7b3-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:59.088386 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.088150    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/385744c6-8d34-45c9-ab18-e174578df7b3-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:08:59.657291 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.657256    2575 generic.go:356] "Generic (PLEG): container finished" podID="385744c6-8d34-45c9-ab18-e174578df7b3" containerID="a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f" exitCode=0
Jul 08 18:08:59.657463 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.657296    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"
Jul 08 18:08:59.657463 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.657333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" event={"ID":"385744c6-8d34-45c9-ab18-e174578df7b3","Type":"ContainerDied","Data":"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"}
Jul 08 18:08:59.657463 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.657375    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh" event={"ID":"385744c6-8d34-45c9-ab18-e174578df7b3","Type":"ContainerDied","Data":"3c999293dd5e21bf8ee3a076f4e1aae488193a4a6e5d6e2db8444c699752e8b9"}
Jul 08 18:08:59.657463 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.657393    2575 scope.go:117] "RemoveContainer" containerID="a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"
Jul 08 18:08:59.665951 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.665935    2575 scope.go:117] "RemoveContainer" containerID="a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"
Jul 08 18:08:59.666210 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:08:59.666191    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f\": container with ID starting with a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f not found: ID does not exist" containerID="a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"
Jul 08 18:08:59.666257 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.666220    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f"} err="failed to get container status \"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f\": rpc error: code = NotFound desc = could not find container \"a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f\": container with ID starting with a46037204c75dd628f0e41faf1139a92c4c448950f0ec106ee558444ac0e545f not found: ID does not exist"
Jul 08 18:08:59.674668 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.674645    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:08:59.678969 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:08:59.678947    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-253d53e7/e2e-lifecycle-model-253d53e7-kserve-6667fc6bc9-qclqh"]
Jul 08 18:09:01.602749 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:09:01.602713    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="385744c6-8d34-45c9-ab18-e174578df7b3" path="/var/lib/kubelet/pods/385744c6-8d34-45c9-ab18-e174578df7b3/volumes"
Jul 08 18:10:27.792851 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.792810    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793173    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="385744c6-8d34-45c9-ab18-e174578df7b3" containerName="main"
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793183    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="385744c6-8d34-45c9-ab18-e174578df7b3" containerName="main"
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793198    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" containerName="maas-api"
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793204    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" containerName="maas-api"
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793266    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c54f63bb-0d47-4496-b5d6-6e1678ba3d40" containerName="maas-api"
Jul 08 18:10:27.793362 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.793278    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="385744c6-8d34-45c9-ab18-e174578df7b3" containerName="main"
Jul 08 18:10:27.796287 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.796260    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.799747 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.799726    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-975810-serving-cert\""
Jul 08 18:10:27.821447 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.821395    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:10:27.843411 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.843373    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.843628 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.843455    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwgn\" (UniqueName: \"kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.843628 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.843503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.943935 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.943890    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwgn\" (UniqueName: \"kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.944147 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.943965    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.944147 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.944011    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.944778 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.944759    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.946539 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.946515    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:27.954641 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:27.954618    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwgn\" (UniqueName: \"kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn\") pod \"maas-api-e2e-inf-a-975810-669c6d6996-fq8wq\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:28.106791 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:28.106693    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:28.265548 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:28.265518    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:10:28.267988 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:10:28.267957    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37ce03af_8e1b_455b_a11a_738c4399ae98.slice/crio-12d977fe20a188f6e358ebaa2339ab5033769e85b4dd573653267ad2a1cc5691 WatchSource:0}: Error finding container 12d977fe20a188f6e358ebaa2339ab5033769e85b4dd573653267ad2a1cc5691: Status 404 returned error can't find the container with id 12d977fe20a188f6e358ebaa2339ab5033769e85b4dd573653267ad2a1cc5691
Jul 08 18:10:28.269676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:28.269654    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 18:10:29.076484 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:29.076455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" event={"ID":"37ce03af-8e1b-455b-a11a-738c4399ae98","Type":"ContainerStarted","Data":"12d977fe20a188f6e358ebaa2339ab5033769e85b4dd573653267ad2a1cc5691"}
Jul 08 18:10:30.083136 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:30.083093    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" event={"ID":"37ce03af-8e1b-455b-a11a-738c4399ae98","Type":"ContainerStarted","Data":"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"}
Jul 08 18:10:30.083557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:30.083248    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:30.103610 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:30.103563    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" podStartSLOduration=2.371429762 podStartE2EDuration="3.103549637s" totalImagesPullingTime="732.119875ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:30.101531428 +0000 UTC m=+2218.968061472" watchObservedRunningTime="2026-07-08 18:10:30.103549637 +0000 UTC m=+2218.970079679"
Jul 08 18:10:35.779862 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.779824    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:10:35.783885 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.783859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.786446 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.786404    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3be673-serving-cert\""
Jul 08 18:10:35.800292 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.800269    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:10:35.807197 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.807169    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv95k\" (UniqueName: \"kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.807323 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.807219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.807323 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.807261    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.907811 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.907777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv95k\" (UniqueName: \"kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.907997 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.907828    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.907997 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.907862    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.907997 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:10:35.907987    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-serving-cert: secret "maas-api-e2e-inf-b-3be673-serving-cert" not found
Jul 08 18:10:35.908105 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:10:35.908066    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls podName:a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a nodeName:}" failed. No retries permitted until 2026-07-08 18:10:36.408035957 +0000 UTC m=+2225.274565978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls") pod "maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" (UID: "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a") : secret "maas-api-e2e-inf-b-3be673-serving-cert" not found
Jul 08 18:10:35.908595 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.908575    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:35.917317 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:35.917294    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv95k\" (UniqueName: \"kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:36.093941 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:36.093861    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:10:36.412579 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:36.412540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:36.415077 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:36.415053    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:36.694341 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:36.694246    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:36.833515 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:36.833489    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:10:36.836529 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:10:36.836487    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda49d3a5e_fda1_453b_badc_3cf1c1fb0f9a.slice/crio-84b3e92d24d321d8183bbe7901af406a0a759d613d7b6f339f222f89463e00c6 WatchSource:0}: Error finding container 84b3e92d24d321d8183bbe7901af406a0a759d613d7b6f339f222f89463e00c6: Status 404 returned error can't find the container with id 84b3e92d24d321d8183bbe7901af406a0a759d613d7b6f339f222f89463e00c6
Jul 08 18:10:37.114871 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:37.114837    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" event={"ID":"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a","Type":"ContainerStarted","Data":"84b3e92d24d321d8183bbe7901af406a0a759d613d7b6f339f222f89463e00c6"}
Jul 08 18:10:38.121052 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:38.121013    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" event={"ID":"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a","Type":"ContainerStarted","Data":"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"}
Jul 08 18:10:38.121545 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:38.121096    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:10:38.144101 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:38.144040    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" podStartSLOduration=2.728035868 podStartE2EDuration="3.144021056s" totalImagesPullingTime="415.985188ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:38.143864303 +0000 UTC m=+2227.010394383" watchObservedRunningTime="2026-07-08 18:10:38.144021056 +0000 UTC m=+2227.010551100"
Jul 08 18:10:44.130693 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:10:44.130660    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:11:04.938589 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.938509    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:11:04.942086 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.942067    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:04.945762 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.945740    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-975810\"/\"kube-root-ca.crt\""
Jul 08 18:11:04.946754 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.946733    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-975810\"/\"openshift-service-ca.crt\""
Jul 08 18:11:04.947028 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.947010    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-975810\"/\"default-dockercfg-z92vf\""
Jul 08 18:11:04.947249 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.947228    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-975810\"/\"test-model-975810-kserve-self-signed-certs\""
Jul 08 18:11:04.955264 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:04.955237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:11:05.055698 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055661    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.055698 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.055942 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8jkc\" (UniqueName: \"kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.055942 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055813    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.055942 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.055942 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.055886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.156988 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.156944    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.156988 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.156998    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8jkc\" (UniqueName: \"kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.157273 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.157026    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.157273 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.157052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.157273 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.157076    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.157273 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.157199    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.158043 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.157957    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.158302 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.158279    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.158458 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.158372    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.159921 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.159893    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.160456 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.160435    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.168103 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.168079    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8jkc\" (UniqueName: \"kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc\") pod \"test-model-975810-kserve-659bf9b7b9-fwhzb\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") " pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.252328 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.252241    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:05.386743 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:05.386717    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:11:05.388855 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:11:05.388825    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ebaf0de_6aa8_4f13_abc5_b682b06b9cdc.slice/crio-50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062 WatchSource:0}: Error finding container 50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062: Status 404 returned error can't find the container with id 50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062
Jul 08 18:11:06.252324 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:06.252289    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" event={"ID":"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc","Type":"ContainerStarted","Data":"06836bf6594fcc30c891509ad8220aac8b87f78f309b691ca4d55809a0f2571f"}
Jul 08 18:11:06.252729 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:06.252329    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" event={"ID":"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc","Type":"ContainerStarted","Data":"50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062"}
Jul 08 18:11:06.279054 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:06.274176    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" podStartSLOduration=2.27415602 podStartE2EDuration="2.27415602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:11:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:11:06.271947879 +0000 UTC m=+2255.138477920" watchObservedRunningTime="2026-07-08 18:11:06.27415602 +0000 UTC m=+2255.140686063"
Jul 08 18:11:15.253108 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:15.253066    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:15.253643 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:15.253153    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:15.265763 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:15.265734    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:15.311753 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:15.311723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:11:59.324137 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:11:59.324099    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:12:01.125032 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.124994    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:12:01.125560 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.125210    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" podUID="37ce03af-8e1b-455b-a11a-738c4399ae98" containerName="maas-api" containerID="cri-o://d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c" gracePeriod=30
Jul 08 18:12:01.377769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.377703    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:12:01.458129 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.458089    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca\") pod \"37ce03af-8e1b-455b-a11a-738c4399ae98\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") "
Jul 08 18:12:01.458308 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.458159    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls\") pod \"37ce03af-8e1b-455b-a11a-738c4399ae98\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") "
Jul 08 18:12:01.458308 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.458200    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jwgn\" (UniqueName: \"kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn\") pod \"37ce03af-8e1b-455b-a11a-738c4399ae98\" (UID: \"37ce03af-8e1b-455b-a11a-738c4399ae98\") "
Jul 08 18:12:01.458492 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.458465    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37ce03af-8e1b-455b-a11a-738c4399ae98" (UID: "37ce03af-8e1b-455b-a11a-738c4399ae98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:12:01.460278 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.460254    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37ce03af-8e1b-455b-a11a-738c4399ae98" (UID: "37ce03af-8e1b-455b-a11a-738c4399ae98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:12:01.460278 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.460266    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn" (OuterVolumeSpecName: "kube-api-access-2jwgn") pod "37ce03af-8e1b-455b-a11a-738c4399ae98" (UID: "37ce03af-8e1b-455b-a11a-738c4399ae98"). InnerVolumeSpecName "kube-api-access-2jwgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:12:01.518520 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.518484    2575 generic.go:356] "Generic (PLEG): container finished" podID="37ce03af-8e1b-455b-a11a-738c4399ae98" containerID="d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c" exitCode=0
Jul 08 18:12:01.518676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.518538    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"
Jul 08 18:12:01.518676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.518569    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" event={"ID":"37ce03af-8e1b-455b-a11a-738c4399ae98","Type":"ContainerDied","Data":"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"}
Jul 08 18:12:01.518676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.518641    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq" event={"ID":"37ce03af-8e1b-455b-a11a-738c4399ae98","Type":"ContainerDied","Data":"12d977fe20a188f6e358ebaa2339ab5033769e85b4dd573653267ad2a1cc5691"}
Jul 08 18:12:01.518676 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.518663    2575 scope.go:117] "RemoveContainer" containerID="d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"
Jul 08 18:12:01.527946 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.527917    2575 scope.go:117] "RemoveContainer" containerID="d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"
Jul 08 18:12:01.528195 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:12:01.528175    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c\": container with ID starting with d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c not found: ID does not exist" containerID="d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"
Jul 08 18:12:01.528253 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.528202    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c"} err="failed to get container status \"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c\": rpc error: code = NotFound desc = could not find container \"d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c\": container with ID starting with d6ab27a6f4b69abfb7f742b6e031f185d15a071ad52d8b7466d633aa6a76a07c not found: ID does not exist"
Jul 08 18:12:01.543205 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.543175    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:12:01.548153 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.548133    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-975810-669c6d6996-fq8wq"]
Jul 08 18:12:01.559762 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.559739    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37ce03af-8e1b-455b-a11a-738c4399ae98-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:01.559824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.559764    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37ce03af-8e1b-455b-a11a-738c4399ae98-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:01.559824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.559774    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jwgn\" (UniqueName: \"kubernetes.io/projected/37ce03af-8e1b-455b-a11a-738c4399ae98-kube-api-access-2jwgn\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:01.603473 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:01.603452    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ce03af-8e1b-455b-a11a-738c4399ae98" path="/var/lib/kubelet/pods/37ce03af-8e1b-455b-a11a-738c4399ae98/volumes"
Jul 08 18:12:14.344116 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.344073    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" podUID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" containerName="main" containerID="cri-o://06836bf6594fcc30c891509ad8220aac8b87f78f309b691ca4d55809a0f2571f" gracePeriod=45
Jul 08 18:12:14.583234 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.583199    2575 generic.go:356] "Generic (PLEG): container finished" podID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" containerID="06836bf6594fcc30c891509ad8220aac8b87f78f309b691ca4d55809a0f2571f" exitCode=0
Jul 08 18:12:14.583346 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.583262    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" event={"ID":"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc","Type":"ContainerDied","Data":"06836bf6594fcc30c891509ad8220aac8b87f78f309b691ca4d55809a0f2571f"}
Jul 08 18:12:14.583346 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.583301    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb" event={"ID":"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc","Type":"ContainerDied","Data":"50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062"}
Jul 08 18:12:14.583346 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.583316    2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50bc8c3a071cf8a265f3cf7aab99936b51edef9bfd0e3fd6ef8cd53325d05062"
Jul 08 18:12:14.592178 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.592160    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:12:14.668305 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668271    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8jkc\" (UniqueName: \"kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668318    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668357    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668373    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668400    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668725 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668584    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache\") pod \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\" (UID: \"5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc\") "
Jul 08 18:12:14.668725 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668701    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home" (OuterVolumeSpecName: "home") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:12:14.668837 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668715    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:12:14.668892 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668820    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:12:14.668966 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668945    2575 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tmp-dir\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:14.669004 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668971    2575 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-home\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:14.669004 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.668985    2575 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-model-cache\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:14.670561 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.670537    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm" (OuterVolumeSpecName: "dshm") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 18:12:14.670674 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.670564    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc" (OuterVolumeSpecName: "kube-api-access-m8jkc") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "kube-api-access-m8jkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:12:14.670674 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.670572    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" (UID: "5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:12:14.769832 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.769794    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8jkc\" (UniqueName: \"kubernetes.io/projected/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-kube-api-access-m8jkc\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:14.769832 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.769825    2575 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-dshm\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:14.769832 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:14.769837    2575 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc-tls-certs\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:15.588204 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:15.588172    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"
Jul 08 18:12:15.613202 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:15.613165    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:12:15.618500 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:15.618471    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-975810/test-model-975810-kserve-659bf9b7b9-fwhzb"]
Jul 08 18:12:17.601917 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:17.601882    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" path="/var/lib/kubelet/pods/5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc/volumes"
Jul 08 18:12:44.850548 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:44.850517    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:12:44.851024 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:44.850724    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" podUID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" containerName="maas-api" containerID="cri-o://477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439" gracePeriod=30
Jul 08 18:12:45.103470 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.103392    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:12:45.234152 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.234122    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") pod \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") "
Jul 08 18:12:45.234357 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.234161    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca\") pod \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") "
Jul 08 18:12:45.234357 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.234190    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv95k\" (UniqueName: \"kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k\") pod \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\" (UID: \"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a\") "
Jul 08 18:12:45.234503 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.234477    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" (UID: "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:12:45.236233 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.236204    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" (UID: "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:12:45.236233 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.236205    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k" (OuterVolumeSpecName: "kube-api-access-rv95k") pod "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" (UID: "a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a"). InnerVolumeSpecName "kube-api-access-rv95k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:12:45.335044 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.335001    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:45.335044 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.335037    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:45.335245 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.335053    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv95k\" (UniqueName: \"kubernetes.io/projected/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a-kube-api-access-rv95k\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:12:45.721685 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.721649    2575 generic.go:356] "Generic (PLEG): container finished" podID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" containerID="477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439" exitCode=0
Jul 08 18:12:45.721858 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.721707    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"
Jul 08 18:12:45.721858 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.721709    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" event={"ID":"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a","Type":"ContainerDied","Data":"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"}
Jul 08 18:12:45.721858 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.721847    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw" event={"ID":"a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a","Type":"ContainerDied","Data":"84b3e92d24d321d8183bbe7901af406a0a759d613d7b6f339f222f89463e00c6"}
Jul 08 18:12:45.721973 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.721867    2575 scope.go:117] "RemoveContainer" containerID="477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"
Jul 08 18:12:45.730288 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.730270    2575 scope.go:117] "RemoveContainer" containerID="477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"
Jul 08 18:12:45.730583 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:12:45.730560    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439\": container with ID starting with 477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439 not found: ID does not exist" containerID="477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"
Jul 08 18:12:45.730583 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.730588    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439"} err="failed to get container status \"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439\": rpc error: code = NotFound desc = could not find container \"477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439\": container with ID starting with 477184e8868da0c8ca201af8c6a3e6d44b151489bfe6917373daeb26b174f439 not found: ID does not exist"
Jul 08 18:12:45.740122 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.740095    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:12:45.746829 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:45.746809    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be673-6d75575ff7-xbrfw"]
Jul 08 18:12:47.602778 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:47.602746    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" path="/var/lib/kubelet/pods/a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a/volumes"
Jul 08 18:12:55.528173 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528141    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528508    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ce03af-8e1b-455b-a11a-738c4399ae98" containerName="maas-api"
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528520    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ce03af-8e1b-455b-a11a-738c4399ae98" containerName="maas-api"
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528530    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" containerName="maas-api"
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528536    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" containerName="maas-api"
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528543    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" containerName="main"
Jul 08 18:12:55.528585 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528548    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" containerName="main"
Jul 08 18:12:55.528803 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528594    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="a49d3a5e-fda1-453b-badc-3cf1c1fb0f9a" containerName="maas-api"
Jul 08 18:12:55.528803 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528604    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ebaf0de-6aa8-4f13-abc5-b682b06b9cdc" containerName="main"
Jul 08 18:12:55.528803 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.528611    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ce03af-8e1b-455b-a11a-738c4399ae98" containerName="maas-api"
Jul 08 18:12:55.531501 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.531484    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.535869 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.535835    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-f4e475-serving-cert\""
Jul 08 18:12:55.551316 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.551281    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:12:55.624886 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.624857    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.625046 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.624905    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4mht\" (UniqueName: \"kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.625046 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.624931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.725853 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.725819    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.726017 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.725878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4mht\" (UniqueName: \"kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.726017 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:12:55.725970    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-serving-cert: secret "maas-api-e2e-api-a-f4e475-serving-cert" not found
Jul 08 18:12:55.726017 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.726005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.726147 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:12:55.726037    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls podName:9df39fce-30e7-4b60-925f-4f4728e97d76 nodeName:}" failed. No retries permitted until 2026-07-08 18:12:56.226021091 +0000 UTC m=+2365.092551111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls") pod "maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" (UID: "9df39fce-30e7-4b60-925f-4f4728e97d76") : secret "maas-api-e2e-api-a-f4e475-serving-cert" not found
Jul 08 18:12:55.726625 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.726606    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:55.736909 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:55.736880    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4mht\" (UniqueName: \"kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:56.229980 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:56.229943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:56.232814 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:56.232782    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") pod \"maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:56.441745 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:56.441709    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:56.583262 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:56.583237    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:12:56.585546 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:12:56.585518    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df39fce_30e7_4b60_925f_4f4728e97d76.slice/crio-09da8c82edf5a5ba1725f0c67ae76ec04a129bc3c61736a44f26a0f448805904 WatchSource:0}: Error finding container 09da8c82edf5a5ba1725f0c67ae76ec04a129bc3c61736a44f26a0f448805904: Status 404 returned error can't find the container with id 09da8c82edf5a5ba1725f0c67ae76ec04a129bc3c61736a44f26a0f448805904
Jul 08 18:12:56.775177 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:56.775075    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" event={"ID":"9df39fce-30e7-4b60-925f-4f4728e97d76","Type":"ContainerStarted","Data":"09da8c82edf5a5ba1725f0c67ae76ec04a129bc3c61736a44f26a0f448805904"}
Jul 08 18:12:57.781173 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:57.781140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" event={"ID":"9df39fce-30e7-4b60-925f-4f4728e97d76","Type":"ContainerStarted","Data":"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"}
Jul 08 18:12:57.781574 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:57.781266    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:12:57.801433 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:12:57.801260    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" podStartSLOduration=2.225947691 podStartE2EDuration="2.801241946s" totalImagesPullingTime="575.294255ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:12:57.800660708 +0000 UTC m=+2366.667190772" watchObservedRunningTime="2026-07-08 18:12:57.801241946 +0000 UTC m=+2366.667771991"
Jul 08 18:13:03.476684 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.476650    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:03.479805 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.479788    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.484237 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.484194    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-761617-serving-cert\""
Jul 08 18:13:03.494127 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.494098    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:03.594774 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.594742    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.594954 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.594802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f29g\" (UniqueName: \"kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.594954 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.594873    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.695848 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.695798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f29g\" (UniqueName: \"kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.696048 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.695894    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.696048 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.695967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.697012 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.696982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.699633 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.699611    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.704646 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.704624    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f29g\" (UniqueName: \"kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g\") pod \"maas-api-e2e-api-b-761617-6c46cb654d-tk8qn\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.791062 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.790967    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:03.791720 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.791696    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:13:03.938847 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:03.938822    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:03.941621 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:13:03.941578    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e7f905_f254_4b49_b9cb_f5bb308a1842.slice/crio-0292b16d9f480a266683959f8d11a594ada74164a12a3dd89d3c7b4de1a8704d WatchSource:0}: Error finding container 0292b16d9f480a266683959f8d11a594ada74164a12a3dd89d3c7b4de1a8704d: Status 404 returned error can't find the container with id 0292b16d9f480a266683959f8d11a594ada74164a12a3dd89d3c7b4de1a8704d
Jul 08 18:13:04.814660 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:04.814580    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" event={"ID":"95e7f905-f254-4b49-b9cb-f5bb308a1842","Type":"ContainerStarted","Data":"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"}
Jul 08 18:13:04.814660 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:04.814633    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" event={"ID":"95e7f905-f254-4b49-b9cb-f5bb308a1842","Type":"ContainerStarted","Data":"0292b16d9f480a266683959f8d11a594ada74164a12a3dd89d3c7b4de1a8704d"}
Jul 08 18:13:04.815065 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:04.814723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:04.836043 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:04.835995    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" podStartSLOduration=1.303350559 podStartE2EDuration="1.835980877s" totalImagesPullingTime="532.630318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:04.832779201 +0000 UTC m=+2373.699309245" watchObservedRunningTime="2026-07-08 18:13:04.835980877 +0000 UTC m=+2373.702510918"
Jul 08 18:13:10.825094 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:10.825061    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:17.087579 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.087535    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:13:17.088047 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.087776    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" podUID="9df39fce-30e7-4b60-925f-4f4728e97d76" containerName="maas-api" containerID="cri-o://433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620" gracePeriod=30
Jul 08 18:13:17.332541 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.332513    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:13:17.398104 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.398072    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca\") pod \"9df39fce-30e7-4b60-925f-4f4728e97d76\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") "
Jul 08 18:13:17.398104 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.398107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") pod \"9df39fce-30e7-4b60-925f-4f4728e97d76\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") "
Jul 08 18:13:17.398356 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.398179    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4mht\" (UniqueName: \"kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht\") pod \"9df39fce-30e7-4b60-925f-4f4728e97d76\" (UID: \"9df39fce-30e7-4b60-925f-4f4728e97d76\") "
Jul 08 18:13:17.398545 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.398519    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9df39fce-30e7-4b60-925f-4f4728e97d76" (UID: "9df39fce-30e7-4b60-925f-4f4728e97d76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:13:17.400326 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.400300    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9df39fce-30e7-4b60-925f-4f4728e97d76" (UID: "9df39fce-30e7-4b60-925f-4f4728e97d76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:13:17.400427 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.400398    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht" (OuterVolumeSpecName: "kube-api-access-t4mht") pod "9df39fce-30e7-4b60-925f-4f4728e97d76" (UID: "9df39fce-30e7-4b60-925f-4f4728e97d76"). InnerVolumeSpecName "kube-api-access-t4mht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:13:17.499550 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.499515    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9df39fce-30e7-4b60-925f-4f4728e97d76-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:17.499550 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.499544    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9df39fce-30e7-4b60-925f-4f4728e97d76-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:17.499550 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.499553    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4mht\" (UniqueName: \"kubernetes.io/projected/9df39fce-30e7-4b60-925f-4f4728e97d76-kube-api-access-t4mht\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:17.878550 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.878512    2575 generic.go:356] "Generic (PLEG): container finished" podID="9df39fce-30e7-4b60-925f-4f4728e97d76" containerID="433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620" exitCode=0
Jul 08 18:13:17.878735 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.878560    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"
Jul 08 18:13:17.878735 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.878581    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" event={"ID":"9df39fce-30e7-4b60-925f-4f4728e97d76","Type":"ContainerDied","Data":"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"}
Jul 08 18:13:17.878735 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.878642    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h" event={"ID":"9df39fce-30e7-4b60-925f-4f4728e97d76","Type":"ContainerDied","Data":"09da8c82edf5a5ba1725f0c67ae76ec04a129bc3c61736a44f26a0f448805904"}
Jul 08 18:13:17.878735 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.878670    2575 scope.go:117] "RemoveContainer" containerID="433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"
Jul 08 18:13:17.887369 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.887351    2575 scope.go:117] "RemoveContainer" containerID="433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"
Jul 08 18:13:17.887652 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:17.887633    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620\": container with ID starting with 433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620 not found: ID does not exist" containerID="433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"
Jul 08 18:13:17.887714 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.887661    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620"} err="failed to get container status \"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620\": rpc error: code = NotFound desc = could not find container \"433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620\": container with ID starting with 433da9508b847f5e75e670646b28ec214aae3e818499b24a552f152c30be1620 not found: ID does not exist"
Jul 08 18:13:17.894663 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.894642    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:13:17.903801 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:17.903771    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-f4e475-9fd489bb-7zn2h"]
Jul 08 18:13:19.602059 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:19.602027    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df39fce-30e7-4b60-925f-4f4728e97d76" path="/var/lib/kubelet/pods/9df39fce-30e7-4b60-925f-4f4728e97d76/volumes"
Jul 08 18:13:24.630954 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.630911    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:24.631458 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.631180    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" podUID="95e7f905-f254-4b49-b9cb-f5bb308a1842" containerName="maas-api" containerID="cri-o://f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f" gracePeriod=30
Jul 08 18:13:24.885806 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.885742    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:24.914900 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.914866    2575 generic.go:356] "Generic (PLEG): container finished" podID="95e7f905-f254-4b49-b9cb-f5bb308a1842" containerID="f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f" exitCode=0
Jul 08 18:13:24.915056 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.914919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"
Jul 08 18:13:24.915056 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.914939    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" event={"ID":"95e7f905-f254-4b49-b9cb-f5bb308a1842","Type":"ContainerDied","Data":"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"}
Jul 08 18:13:24.915056 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.914996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn" event={"ID":"95e7f905-f254-4b49-b9cb-f5bb308a1842","Type":"ContainerDied","Data":"0292b16d9f480a266683959f8d11a594ada74164a12a3dd89d3c7b4de1a8704d"}
Jul 08 18:13:24.915056 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.915022    2575 scope.go:117] "RemoveContainer" containerID="f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"
Jul 08 18:13:24.923719 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.923695    2575 scope.go:117] "RemoveContainer" containerID="f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"
Jul 08 18:13:24.923985 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:24.923960    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f\": container with ID starting with f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f not found: ID does not exist" containerID="f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"
Jul 08 18:13:24.924045 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.923998    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f"} err="failed to get container status \"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f\": rpc error: code = NotFound desc = could not find container \"f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f\": container with ID starting with f94c9aaffd9b942e958f0afccbd9ee62626c936155af65388ec63e8ee09ad00f not found: ID does not exist"
Jul 08 18:13:24.963913 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.963879    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f29g\" (UniqueName: \"kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g\") pod \"95e7f905-f254-4b49-b9cb-f5bb308a1842\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") "
Jul 08 18:13:24.964119 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.963927    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca\") pod \"95e7f905-f254-4b49-b9cb-f5bb308a1842\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") "
Jul 08 18:13:24.964119 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.963981    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls\") pod \"95e7f905-f254-4b49-b9cb-f5bb308a1842\" (UID: \"95e7f905-f254-4b49-b9cb-f5bb308a1842\") "
Jul 08 18:13:24.964309 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.964281    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95e7f905-f254-4b49-b9cb-f5bb308a1842" (UID: "95e7f905-f254-4b49-b9cb-f5bb308a1842"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:13:24.965945 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.965917    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g" (OuterVolumeSpecName: "kube-api-access-4f29g") pod "95e7f905-f254-4b49-b9cb-f5bb308a1842" (UID: "95e7f905-f254-4b49-b9cb-f5bb308a1842"). InnerVolumeSpecName "kube-api-access-4f29g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:13:24.966037 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:24.966018    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95e7f905-f254-4b49-b9cb-f5bb308a1842" (UID: "95e7f905-f254-4b49-b9cb-f5bb308a1842"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:13:25.065497 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.065463    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f29g\" (UniqueName: \"kubernetes.io/projected/95e7f905-f254-4b49-b9cb-f5bb308a1842-kube-api-access-4f29g\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:25.065497 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.065494    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e7f905-f254-4b49-b9cb-f5bb308a1842-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:25.065497 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.065505    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95e7f905-f254-4b49-b9cb-f5bb308a1842-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:13:25.247870 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.247837    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:25.253927 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.253897    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-761617-6c46cb654d-tk8qn"]
Jul 08 18:13:25.602446 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:25.602339    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e7f905-f254-4b49-b9cb-f5bb308a1842" path="/var/lib/kubelet/pods/95e7f905-f254-4b49-b9cb-f5bb308a1842/volumes"
Jul 08 18:13:31.660801 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:31.660767    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:13:31.668793 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:31.668772    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4zpzs_e76792ab-dfda-4b1a-aa06-2ddadacd7cee/ovn-acl-logging/0.log"
Jul 08 18:13:34.818275 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818241    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818594    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df39fce-30e7-4b60-925f-4f4728e97d76" containerName="maas-api"
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818606    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df39fce-30e7-4b60-925f-4f4728e97d76" containerName="maas-api"
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818621    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e7f905-f254-4b49-b9cb-f5bb308a1842" containerName="maas-api"
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818627    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e7f905-f254-4b49-b9cb-f5bb308a1842" containerName="maas-api"
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818678    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e7f905-f254-4b49-b9cb-f5bb308a1842" containerName="maas-api"
Jul 08 18:13:34.819075 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.818686    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df39fce-30e7-4b60-925f-4f4728e97d76" containerName="maas-api"
Jul 08 18:13:34.822659 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.822634    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:34.826007 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.825988    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f1c56e-serving-cert\""
Jul 08 18:13:34.837715 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.837689    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:13:34.952681 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.952647    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2qts\" (UniqueName: \"kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:34.952853 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.952713    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:34.952853 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:34.952751    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.053915 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.053885    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.054083 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.053929    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.054083 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.054034    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2qts\" (UniqueName: \"kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.054160 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:35.054105    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-serving-cert: secret "maas-api-e2e-shared-a-f1c56e-serving-cert" not found
Jul 08 18:13:35.054194 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:35.054165    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls podName:d9218061-4e94-480d-819a-12a42be6a014 nodeName:}" failed. No retries permitted until 2026-07-08 18:13:35.554149828 +0000 UTC m=+2404.420679848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls") pod "maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" (UID: "d9218061-4e94-480d-819a-12a42be6a014") : secret "maas-api-e2e-shared-a-f1c56e-serving-cert" not found
Jul 08 18:13:35.054588 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.054570    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.086520 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.086455    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2qts\" (UniqueName: \"kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.560515 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.560479    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.562856 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.562834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") pod \"maas-api-e2e-shared-a-f1c56e-576dc45978-527qq\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.733067 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.733032    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:35.868889 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.868855    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:13:35.872644 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:13:35.872605    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9218061_4e94_480d_819a_12a42be6a014.slice/crio-5078be6cfc49485bfc84b6d47d9b30f00e10bf1a13333f707e9bbd1edfda0025 WatchSource:0}: Error finding container 5078be6cfc49485bfc84b6d47d9b30f00e10bf1a13333f707e9bbd1edfda0025: Status 404 returned error can't find the container with id 5078be6cfc49485bfc84b6d47d9b30f00e10bf1a13333f707e9bbd1edfda0025
Jul 08 18:13:35.966616 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:35.966579    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" event={"ID":"d9218061-4e94-480d-819a-12a42be6a014","Type":"ContainerStarted","Data":"5078be6cfc49485bfc84b6d47d9b30f00e10bf1a13333f707e9bbd1edfda0025"}
Jul 08 18:13:36.973403 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:36.973365    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" event={"ID":"d9218061-4e94-480d-819a-12a42be6a014","Type":"ContainerStarted","Data":"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"}
Jul 08 18:13:36.973842 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:36.973570    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:36.999850 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:36.999804    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" podStartSLOduration=2.657185773 podStartE2EDuration="2.999790345s" totalImagesPullingTime="342.604572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:36.998479532 +0000 UTC m=+2405.865009592" watchObservedRunningTime="2026-07-08 18:13:36.999790345 +0000 UTC m=+2405.866320428"
Jul 08 18:13:42.985302 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:42.985273    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:13:42.999497 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:42.999463    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:13:43.002828 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.002807    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.006048 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.006032    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-d5f862-serving-cert\""
Jul 08 18:13:43.038436 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.038387    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:13:43.125359 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.125328    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.125539 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.125377    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.125589 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.125536    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddn7\" (UniqueName: \"kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.226769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.226730    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddn7\" (UniqueName: \"kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.226769 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.226772    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.226983 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.226797    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.226983 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:43.226906    2575 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-serving-cert: secret "maas-api-e2e-shared-b-d5f862-serving-cert" not found
Jul 08 18:13:43.226983 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:13:43.226958    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls podName:277be6b4-9e8b-44b5-83ba-702c1ac93ae1 nodeName:}" failed. No retries permitted until 2026-07-08 18:13:43.726942728 +0000 UTC m=+2412.593472749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls") pod "maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" (UID: "277be6b4-9e8b-44b5-83ba-702c1ac93ae1") : secret "maas-api-e2e-shared-b-d5f862-serving-cert" not found
Jul 08 18:13:43.227487 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.227467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.240878 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.240811    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddn7\" (UniqueName: \"kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.732213 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.732173    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.734758 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.734735    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") pod \"maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:43.913468 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:43.913409    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:44.060021 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:44.059994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:13:44.062688 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:13:44.062655    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277be6b4_9e8b_44b5_83ba_702c1ac93ae1.slice/crio-f6a254615d2143c735c26c95feef50f940a249e3b0a1f84e6c0b480f6f3394d8 WatchSource:0}: Error finding container f6a254615d2143c735c26c95feef50f940a249e3b0a1f84e6c0b480f6f3394d8: Status 404 returned error can't find the container with id f6a254615d2143c735c26c95feef50f940a249e3b0a1f84e6c0b480f6f3394d8
Jul 08 18:13:45.013543 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:45.013489    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" event={"ID":"277be6b4-9e8b-44b5-83ba-702c1ac93ae1","Type":"ContainerStarted","Data":"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"}
Jul 08 18:13:45.013725 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:45.013594    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" event={"ID":"277be6b4-9e8b-44b5-83ba-702c1ac93ae1","Type":"ContainerStarted","Data":"f6a254615d2143c735c26c95feef50f940a249e3b0a1f84e6c0b480f6f3394d8"}
Jul 08 18:13:45.013725 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:45.013623    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:13:45.035575 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:45.035518    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" podStartSLOduration=2.670268931 podStartE2EDuration="3.03550135s" totalImagesPullingTime="365.232419ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:45.033616429 +0000 UTC m=+2413.900146470" watchObservedRunningTime="2026-07-08 18:13:45.03550135 +0000 UTC m=+2413.902031435"
Jul 08 18:13:51.023221 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:13:51.023190    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:15:00.192874 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.192831    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:15:00.196647 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.196624    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:15:00.196771 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.196738    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:15:00.200395 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.200374    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:15:00.200532 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.200493    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:15:00.203808 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.203612    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:15:00.228210 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.228187    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:15:00.234825 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.234803    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:15:00.240169 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.240147    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:15:00.270968 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.270939    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22rbr\" (UniqueName: \"kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr\") pod \"maas-api-key-cleanup-29725575-fgz7p\" (UID: \"3602ff6c-9fe6-4466-8b56-569f0713d38f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:15:00.271131 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.271002    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jdp5\" (UniqueName: \"kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5\") pod \"maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz\" (UID: \"28874fe5-65b9-4db0-802e-eee62b5efe7e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:15:00.271131 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.271069    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjt6p\" (UniqueName: \"kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p\") pod \"maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl\" (UID: \"5b3b5680-338d-4848-9a76-dee1964a150b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:15:00.371866 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.371834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jdp5\" (UniqueName: \"kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5\") pod \"maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz\" (UID: \"28874fe5-65b9-4db0-802e-eee62b5efe7e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:15:00.372037 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.371896    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjt6p\" (UniqueName: \"kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p\") pod \"maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl\" (UID: \"5b3b5680-338d-4848-9a76-dee1964a150b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:15:00.372037 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.371937    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22rbr\" (UniqueName: \"kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr\") pod \"maas-api-key-cleanup-29725575-fgz7p\" (UID: \"3602ff6c-9fe6-4466-8b56-569f0713d38f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:15:00.382708 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.382678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22rbr\" (UniqueName: \"kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr\") pod \"maas-api-key-cleanup-29725575-fgz7p\" (UID: \"3602ff6c-9fe6-4466-8b56-569f0713d38f\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:15:00.382851 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.382725    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jdp5\" (UniqueName: \"kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5\") pod \"maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz\" (UID: \"28874fe5-65b9-4db0-802e-eee62b5efe7e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:15:00.384304 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.384284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjt6p\" (UniqueName: \"kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p\") pod \"maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl\" (UID: \"5b3b5680-338d-4848-9a76-dee1964a150b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:15:00.507691 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.507596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:15:00.514722 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.514704    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:15:00.520474 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.520453    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:15:00.686508 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.686473    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:15:00.690980 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:15:00.690945    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3602ff6c_9fe6_4466_8b56_569f0713d38f.slice/crio-347ebd3c5769f516e6b6f7d846d1cb28013ca514b14079e71f3e03d0035a375d WatchSource:0}: Error finding container 347ebd3c5769f516e6b6f7d846d1cb28013ca514b14079e71f3e03d0035a375d: Status 404 returned error can't find the container with id 347ebd3c5769f516e6b6f7d846d1cb28013ca514b14079e71f3e03d0035a375d
Jul 08 18:15:00.901300 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.901255    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:15:00.901556 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:15:00.901528    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3b5680_338d_4848_9a76_dee1964a150b.slice/crio-2e3b74234b4adfd841380e5f8822d0b17097fb256e566903b70f7629107117ad WatchSource:0}: Error finding container 2e3b74234b4adfd841380e5f8822d0b17097fb256e566903b70f7629107117ad: Status 404 returned error can't find the container with id 2e3b74234b4adfd841380e5f8822d0b17097fb256e566903b70f7629107117ad
Jul 08 18:15:00.903622 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:00.903595    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:15:00.904986 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:15:00.904965    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28874fe5_65b9_4db0_802e_eee62b5efe7e.slice/crio-da9195b975639a5929b5997df24c235c7c6e46da3c450128796fc057c5c6d4b0 WatchSource:0}: Error finding container da9195b975639a5929b5997df24c235c7c6e46da3c450128796fc057c5c6d4b0: Status 404 returned error can't find the container with id da9195b975639a5929b5997df24c235c7c6e46da3c450128796fc057c5c6d4b0
Jul 08 18:15:01.366321 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.366283    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" event={"ID":"28874fe5-65b9-4db0-802e-eee62b5efe7e","Type":"ContainerStarted","Data":"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"}
Jul 08 18:15:01.366811 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.366339    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" event={"ID":"28874fe5-65b9-4db0-802e-eee62b5efe7e","Type":"ContainerStarted","Data":"da9195b975639a5929b5997df24c235c7c6e46da3c450128796fc057c5c6d4b0"}
Jul 08 18:15:01.367869 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.367834    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" event={"ID":"5b3b5680-338d-4848-9a76-dee1964a150b","Type":"ContainerStarted","Data":"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"}
Jul 08 18:15:01.368001 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.367881    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" event={"ID":"5b3b5680-338d-4848-9a76-dee1964a150b","Type":"ContainerStarted","Data":"2e3b74234b4adfd841380e5f8822d0b17097fb256e566903b70f7629107117ad"}
Jul 08 18:15:01.369139 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.369119    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" event={"ID":"3602ff6c-9fe6-4466-8b56-569f0713d38f","Type":"ContainerStarted","Data":"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"}
Jul 08 18:15:01.369246 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.369153    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" event={"ID":"3602ff6c-9fe6-4466-8b56-569f0713d38f","Type":"ContainerStarted","Data":"347ebd3c5769f516e6b6f7d846d1cb28013ca514b14079e71f3e03d0035a375d"}
Jul 08 18:15:01.384708 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.384664    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" podStartSLOduration=1.384650768 podStartE2EDuration="1.384650768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:15:01.383799736 +0000 UTC m=+2490.250329804" watchObservedRunningTime="2026-07-08 18:15:01.384650768 +0000 UTC m=+2490.251180788"
Jul 08 18:15:01.407581 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.407481    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" podStartSLOduration=1.4074667 podStartE2EDuration="1.4074667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:15:01.405350977 +0000 UTC m=+2490.271881019" watchObservedRunningTime="2026-07-08 18:15:01.4074667 +0000 UTC m=+2490.273996742"
Jul 08 18:15:01.426951 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:15:01.426903    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" podStartSLOduration=1.426889212 podStartE2EDuration="1.426889212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:15:01.425493702 +0000 UTC m=+2490.292023763" watchObservedRunningTime="2026-07-08 18:15:01.426889212 +0000 UTC m=+2490.293419254"
Jul 08 18:16:00.012910 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.012873    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:16:00.013395 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.013060    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" podUID="28874fe5-65b9-4db0-802e-eee62b5efe7e" containerName="cleanup" containerID="cri-o://9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b" gracePeriod=30
Jul 08 18:16:00.017401 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.017364    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:16:00.017595 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.017574    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" podUID="3602ff6c-9fe6-4466-8b56-569f0713d38f" containerName="cleanup" containerID="cri-o://fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1" gracePeriod=30
Jul 08 18:16:00.019289 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.019266    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:16:00.019503 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:00.019480    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" podUID="5b3b5680-338d-4848-9a76-dee1964a150b" containerName="cleanup" containerID="cri-o://8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394" gracePeriod=30
Jul 08 18:16:30.194151 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.194125    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:16:30.228011 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.227987    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:16:30.232171 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.232148    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:16:30.325338 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.325251    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjt6p\" (UniqueName: \"kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p\") pod \"5b3b5680-338d-4848-9a76-dee1964a150b\" (UID: \"5b3b5680-338d-4848-9a76-dee1964a150b\") "
Jul 08 18:16:30.325338 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.325318    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22rbr\" (UniqueName: \"kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr\") pod \"3602ff6c-9fe6-4466-8b56-569f0713d38f\" (UID: \"3602ff6c-9fe6-4466-8b56-569f0713d38f\") "
Jul 08 18:16:30.325616 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.325347    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jdp5\" (UniqueName: \"kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5\") pod \"28874fe5-65b9-4db0-802e-eee62b5efe7e\" (UID: \"28874fe5-65b9-4db0-802e-eee62b5efe7e\") "
Jul 08 18:16:30.327475 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.327443    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr" (OuterVolumeSpecName: "kube-api-access-22rbr") pod "3602ff6c-9fe6-4466-8b56-569f0713d38f" (UID: "3602ff6c-9fe6-4466-8b56-569f0713d38f"). InnerVolumeSpecName "kube-api-access-22rbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:16:30.327475 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.327461    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p" (OuterVolumeSpecName: "kube-api-access-hjt6p") pod "5b3b5680-338d-4848-9a76-dee1964a150b" (UID: "5b3b5680-338d-4848-9a76-dee1964a150b"). InnerVolumeSpecName "kube-api-access-hjt6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:16:30.327626 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.327490    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5" (OuterVolumeSpecName: "kube-api-access-4jdp5") pod "28874fe5-65b9-4db0-802e-eee62b5efe7e" (UID: "28874fe5-65b9-4db0-802e-eee62b5efe7e"). InnerVolumeSpecName "kube-api-access-4jdp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:16:30.426379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.426347    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjt6p\" (UniqueName: \"kubernetes.io/projected/5b3b5680-338d-4848-9a76-dee1964a150b-kube-api-access-hjt6p\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:30.426379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.426374    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22rbr\" (UniqueName: \"kubernetes.io/projected/3602ff6c-9fe6-4466-8b56-569f0713d38f-kube-api-access-22rbr\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:30.426379 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.426383    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jdp5\" (UniqueName: \"kubernetes.io/projected/28874fe5-65b9-4db0-802e-eee62b5efe7e-kube-api-access-4jdp5\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:30.809351 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.809315    2575 generic.go:356] "Generic (PLEG): container finished" podID="28874fe5-65b9-4db0-802e-eee62b5efe7e" containerID="9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b" exitCode=137
Jul 08 18:16:30.809557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.809361    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"
Jul 08 18:16:30.809557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.809403    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" event={"ID":"28874fe5-65b9-4db0-802e-eee62b5efe7e","Type":"ContainerDied","Data":"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"}
Jul 08 18:16:30.809557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.809486    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz" event={"ID":"28874fe5-65b9-4db0-802e-eee62b5efe7e","Type":"ContainerDied","Data":"da9195b975639a5929b5997df24c235c7c6e46da3c450128796fc057c5c6d4b0"}
Jul 08 18:16:30.809557 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.809513    2575 scope.go:117] "RemoveContainer" containerID="9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"
Jul 08 18:16:30.810763 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.810740    2575 generic.go:356] "Generic (PLEG): container finished" podID="5b3b5680-338d-4848-9a76-dee1964a150b" containerID="8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394" exitCode=137
Jul 08 18:16:30.810866 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.810798    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"
Jul 08 18:16:30.810866 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.810827    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" event={"ID":"5b3b5680-338d-4848-9a76-dee1964a150b","Type":"ContainerDied","Data":"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"}
Jul 08 18:16:30.810988 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.810873    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl" event={"ID":"5b3b5680-338d-4848-9a76-dee1964a150b","Type":"ContainerDied","Data":"2e3b74234b4adfd841380e5f8822d0b17097fb256e566903b70f7629107117ad"}
Jul 08 18:16:30.812162 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.812141    2575 generic.go:356] "Generic (PLEG): container finished" podID="3602ff6c-9fe6-4466-8b56-569f0713d38f" containerID="fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1" exitCode=137
Jul 08 18:16:30.812287 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.812185    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" event={"ID":"3602ff6c-9fe6-4466-8b56-569f0713d38f","Type":"ContainerDied","Data":"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"}
Jul 08 18:16:30.812287 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.812194    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"
Jul 08 18:16:30.812287 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.812212    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p" event={"ID":"3602ff6c-9fe6-4466-8b56-569f0713d38f","Type":"ContainerDied","Data":"347ebd3c5769f516e6b6f7d846d1cb28013ca514b14079e71f3e03d0035a375d"}
Jul 08 18:16:30.819780 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.819758    2575 scope.go:117] "RemoveContainer" containerID="9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"
Jul 08 18:16:30.820069 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:16:30.820049    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b\": container with ID starting with 9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b not found: ID does not exist" containerID="9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"
Jul 08 18:16:30.820136 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.820077    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b"} err="failed to get container status \"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b\": rpc error: code = NotFound desc = could not find container \"9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b\": container with ID starting with 9afd16e61950afa5707fb4298249b60392655f74282961d32d3b5fbdc925f39b not found: ID does not exist"
Jul 08 18:16:30.820136 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.820093    2575 scope.go:117] "RemoveContainer" containerID="8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"
Jul 08 18:16:30.828157 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.828141    2575 scope.go:117] "RemoveContainer" containerID="8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"
Jul 08 18:16:30.828411 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:16:30.828393    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394\": container with ID starting with 8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394 not found: ID does not exist" containerID="8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"
Jul 08 18:16:30.828411 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.828432    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394"} err="failed to get container status \"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394\": rpc error: code = NotFound desc = could not find container \"8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394\": container with ID starting with 8ab51e78a3e483396f6580c9dc4d00c3c476db4fc7665e823364f082c1d1f394 not found: ID does not exist"
Jul 08 18:16:30.828411 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.828449    2575 scope.go:117] "RemoveContainer" containerID="fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"
Jul 08 18:16:30.835849 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.835832    2575 scope.go:117] "RemoveContainer" containerID="fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"
Jul 08 18:16:30.836098 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:16:30.836082    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1\": container with ID starting with fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1 not found: ID does not exist" containerID="fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"
Jul 08 18:16:30.836140 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.836104    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1"} err="failed to get container status \"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1\": rpc error: code = NotFound desc = could not find container \"fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1\": container with ID starting with fcaebe00e2d92e8560e409402871c6989bb6f206250f4f3fd868fc8de5ec88b1 not found: ID does not exist"
Jul 08 18:16:30.837562 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.837543    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:16:30.839247 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.839228    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f1c56e-29725575-vprrz"]
Jul 08 18:16:30.851680 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.851652    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:16:30.853877 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.853855    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d5f862-29725575-z7trl"]
Jul 08 18:16:30.865499 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.865478    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:16:30.869815 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:30.869792    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725575-fgz7p"]
Jul 08 18:16:31.602896 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:31.602867    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28874fe5-65b9-4db0-802e-eee62b5efe7e" path="/var/lib/kubelet/pods/28874fe5-65b9-4db0-802e-eee62b5efe7e/volumes"
Jul 08 18:16:31.603269 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:31.603192    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3602ff6c-9fe6-4466-8b56-569f0713d38f" path="/var/lib/kubelet/pods/3602ff6c-9fe6-4466-8b56-569f0713d38f/volumes"
Jul 08 18:16:31.603488 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:31.603475    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b3b5680-338d-4848-9a76-dee1964a150b" path="/var/lib/kubelet/pods/5b3b5680-338d-4848-9a76-dee1964a150b/volumes"
Jul 08 18:16:52.829975 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:52.829941    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:16:52.830478 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:52.830173    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" podUID="d9218061-4e94-480d-819a-12a42be6a014" containerName="maas-api" containerID="cri-o://d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086" gracePeriod=30
Jul 08 18:16:52.979703 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:52.979666    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" podUID="d9218061-4e94-480d-819a-12a42be6a014" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.50:8443/health\": dial tcp 10.133.0.50:8443: connect: connection refused"
Jul 08 18:16:53.080030 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.079969    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:16:53.123475 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.123443    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2qts\" (UniqueName: \"kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts\") pod \"d9218061-4e94-480d-819a-12a42be6a014\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") "
Jul 08 18:16:53.123619 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.123484    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca\") pod \"d9218061-4e94-480d-819a-12a42be6a014\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") "
Jul 08 18:16:53.123619 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.123510    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") pod \"d9218061-4e94-480d-819a-12a42be6a014\" (UID: \"d9218061-4e94-480d-819a-12a42be6a014\") "
Jul 08 18:16:53.123857 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.123833    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9218061-4e94-480d-819a-12a42be6a014" (UID: "d9218061-4e94-480d-819a-12a42be6a014"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:16:53.125615 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.125583    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts" (OuterVolumeSpecName: "kube-api-access-x2qts") pod "d9218061-4e94-480d-819a-12a42be6a014" (UID: "d9218061-4e94-480d-819a-12a42be6a014"). InnerVolumeSpecName "kube-api-access-x2qts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:16:53.125739 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.125696    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9218061-4e94-480d-819a-12a42be6a014" (UID: "d9218061-4e94-480d-819a-12a42be6a014"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:16:53.224172 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.224136    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2qts\" (UniqueName: \"kubernetes.io/projected/d9218061-4e94-480d-819a-12a42be6a014-kube-api-access-x2qts\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:53.224172 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.224166    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9218061-4e94-480d-819a-12a42be6a014-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:53.224172 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.224176    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9218061-4e94-480d-819a-12a42be6a014-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:16:53.921093 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.921059    2575 generic.go:356] "Generic (PLEG): container finished" podID="d9218061-4e94-480d-819a-12a42be6a014" containerID="d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086" exitCode=0
Jul 08 18:16:53.921513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.921106    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"
Jul 08 18:16:53.921513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.921143    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" event={"ID":"d9218061-4e94-480d-819a-12a42be6a014","Type":"ContainerDied","Data":"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"}
Jul 08 18:16:53.921513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.921199    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq" event={"ID":"d9218061-4e94-480d-819a-12a42be6a014","Type":"ContainerDied","Data":"5078be6cfc49485bfc84b6d47d9b30f00e10bf1a13333f707e9bbd1edfda0025"}
Jul 08 18:16:53.921513 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.921226    2575 scope.go:117] "RemoveContainer" containerID="d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"
Jul 08 18:16:53.929509 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.929491    2575 scope.go:117] "RemoveContainer" containerID="d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"
Jul 08 18:16:53.929748 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:16:53.929724    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086\": container with ID starting with d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086 not found: ID does not exist" containerID="d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"
Jul 08 18:16:53.929839 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.929752    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086"} err="failed to get container status \"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086\": rpc error: code = NotFound desc = could not find container \"d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086\": container with ID starting with d8f57cfa255a11041550cab92cf58f56cec2c6a306a38c16babe8f2d030ec086 not found: ID does not exist"
Jul 08 18:16:53.939397 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.939375    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:16:53.943489 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:53.943469    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f1c56e-576dc45978-527qq"]
Jul 08 18:16:55.602617 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:16:55.602584    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9218061-4e94-480d-819a-12a42be6a014" path="/var/lib/kubelet/pods/d9218061-4e94-480d-819a-12a42be6a014/volumes"
Jul 08 18:17:00.469876 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.469841    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:17:00.470308 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.470085    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" podUID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" containerName="maas-api" containerID="cri-o://efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036" gracePeriod=30
Jul 08 18:17:00.711863 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.711839    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:17:00.788375 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.788278    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca\") pod \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") "
Jul 08 18:17:00.788375 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.788366    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") pod \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") "
Jul 08 18:17:00.788573 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.788409    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cddn7\" (UniqueName: \"kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7\") pod \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\" (UID: \"277be6b4-9e8b-44b5-83ba-702c1ac93ae1\") "
Jul 08 18:17:00.788723 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.788694    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "277be6b4-9e8b-44b5-83ba-702c1ac93ae1" (UID: "277be6b4-9e8b-44b5-83ba-702c1ac93ae1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 18:17:00.790396 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.790368    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7" (OuterVolumeSpecName: "kube-api-access-cddn7") pod "277be6b4-9e8b-44b5-83ba-702c1ac93ae1" (UID: "277be6b4-9e8b-44b5-83ba-702c1ac93ae1"). InnerVolumeSpecName "kube-api-access-cddn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 18:17:00.790554 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.790405    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "277be6b4-9e8b-44b5-83ba-702c1ac93ae1" (UID: "277be6b4-9e8b-44b5-83ba-702c1ac93ae1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 18:17:00.889627 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.889599    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-openshift-service-ca\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:17:00.889627 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.889625    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-maas-api-tls\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:17:00.889627 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.889634    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cddn7\" (UniqueName: \"kubernetes.io/projected/277be6b4-9e8b-44b5-83ba-702c1ac93ae1-kube-api-access-cddn7\") on node \"ip-10-0-141-215.ec2.internal\" DevicePath \"\""
Jul 08 18:17:00.955130 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.955090    2575 generic.go:356] "Generic (PLEG): container finished" podID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" containerID="efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036" exitCode=0
Jul 08 18:17:00.955284 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.955153    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"
Jul 08 18:17:00.955284 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.955180    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" event={"ID":"277be6b4-9e8b-44b5-83ba-702c1ac93ae1","Type":"ContainerDied","Data":"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"}
Jul 08 18:17:00.955284 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.955237    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv" event={"ID":"277be6b4-9e8b-44b5-83ba-702c1ac93ae1","Type":"ContainerDied","Data":"f6a254615d2143c735c26c95feef50f940a249e3b0a1f84e6c0b480f6f3394d8"}
Jul 08 18:17:00.955284 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.955264    2575 scope.go:117] "RemoveContainer" containerID="efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"
Jul 08 18:17:00.964270 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.964254    2575 scope.go:117] "RemoveContainer" containerID="efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"
Jul 08 18:17:00.964535 ip-10-0-141-215 kubenswrapper[2575]: E0708 18:17:00.964516    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036\": container with ID starting with efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036 not found: ID does not exist" containerID="efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"
Jul 08 18:17:00.964613 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.964542    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036"} err="failed to get container status \"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036\": rpc error: code = NotFound desc = could not find container \"efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036\": container with ID starting with efe6e257383bbf91ee840a78fc2bde9aac699b3f5b7e8d41725f756cf789b036 not found: ID does not exist"
Jul 08 18:17:00.978329 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.978297    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:17:00.986428 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:00.986394    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-d5f862-8d6446776-6v4dv"]
Jul 08 18:17:01.602305 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:01.602273    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" path="/var/lib/kubelet/pods/277be6b4-9e8b-44b5-83ba-702c1ac93ae1/volumes"
Jul 08 18:17:11.594956 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:11.594924    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dfppr_4f3c477d-350e-4fac-9fb6-103f60850493/manager/0.log"
Jul 08 18:17:11.720003 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:11.719973    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zwtv8_66e4fd13-6f84-4ba1-8446-1d8fe19e9b56/manager/0.log"
Jul 08 18:17:11.850985 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:11.850901    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f8df59f6f-jwzxj_59e17f33-aae1-475a-aaf8-0d7e8e318a67/manager/0.log"
Jul 08 18:17:11.972256 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:11.972228    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ghnqr_59b7dfd8-091f-48bf-8749-a41366449680/server/0.log"
Jul 08 18:17:12.083955 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:12.083917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bpg98_10635e3c-f49f-4592-b7e7-d6d6c284db9c/manager/0.log"
Jul 08 18:17:12.447360 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:12.447331    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-lwvfv_a73b4be0-7617-4acc-becb-6610a33df643/copy-manifests/0.log"
Jul 08 18:17:12.458204 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:12.458179    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-lwvfv_a73b4be0-7617-4acc-becb-6610a33df643/manager/0.log"
Jul 08 18:17:13.919824 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:13.919795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mfqxl_97eb71fa-daf6-4cdf-b43b-d763f9b8b393/manager/0.log"
Jul 08 18:17:14.502475 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:14.502448    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6nztt_94f40f7c-4f5e-4a50-b98f-386899671fad/manager/0.log"
Jul 08 18:17:14.956490 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:14.956459    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8pbkf_efd0b881-d4f4-47ec-9139-82acc02d3289/discovery/0.log"
Jul 08 18:17:15.162039 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:15.162007    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579f5c748-tgsjr_294e26c4-36d0-4825-874b-7e853656fede/kube-auth-proxy/0.log"
Jul 08 18:17:15.497052 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:15.497022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cnzd_68bea353-a813-4d6f-88b6-cdefd72b8eae/payload-processing/0.log"
Jul 08 18:17:15.937777 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:15.937748    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7z8h5_314006b1-864f-4e00-ac0d-3a5f190f0121/main/0.log"
Jul 08 18:17:23.450661 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:23.450635    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-t8txt_51ec67ed-7a09-4949-bc7a-0e8ea5639460/global-pull-secret-syncer/0.log"
Jul 08 18:17:23.535303 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:23.535276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ntn76_862d283b-1715-4911-936d-276142ca880a/konnectivity-agent/0.log"
Jul 08 18:17:23.617525 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:23.617499    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-215.ec2.internal_3312d77bea947e6b51b42d4a15042bb1/haproxy/0.log"
Jul 08 18:17:28.954896 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:28.954866    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-mfqxl_97eb71fa-daf6-4cdf-b43b-d763f9b8b393/manager/0.log"
Jul 08 18:17:29.304505 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:29.304409    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-6nztt_94f40f7c-4f5e-4a50-b98f-386899671fad/manager/0.log"
Jul 08 18:17:31.696867 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:31.696840    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6scpj_dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869/node-exporter/0.log"
Jul 08 18:17:31.717595 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:31.717565    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6scpj_dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869/kube-rbac-proxy/0.log"
Jul 08 18:17:31.738541 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:31.738518    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6scpj_dd2b25d2-fe1c-4ebb-95da-2e55d7bf6869/init-textfile/0.log"
Jul 08 18:17:32.085838 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.085703    2575 scope.go:117] "RemoveContainer" containerID="06836bf6594fcc30c891509ad8220aac8b87f78f309b691ca4d55809a0f2571f"
Jul 08 18:17:32.275514 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.275487    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/thanos-query/0.log"
Jul 08 18:17:32.297777 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.297751    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/kube-rbac-proxy-web/0.log"
Jul 08 18:17:32.322285 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.322264    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/kube-rbac-proxy/0.log"
Jul 08 18:17:32.348525 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.348448    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/prom-label-proxy/0.log"
Jul 08 18:17:32.369154 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.369128    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/kube-rbac-proxy-rules/0.log"
Jul 08 18:17:32.392657 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:32.392634    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d77fc58c7-kcr9v_56b09829-6171-438c-937b-c3938fa6a2a8/kube-rbac-proxy-metrics/0.log"
Jul 08 18:17:33.536431 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536382    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"]
Jul 08 18:17:33.536921 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536899    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" containerName="maas-api"
Jul 08 18:17:33.536999 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536925    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" containerName="maas-api"
Jul 08 18:17:33.536999 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536952    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b3b5680-338d-4848-9a76-dee1964a150b" containerName="cleanup"
Jul 08 18:17:33.536999 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536961    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b3b5680-338d-4848-9a76-dee1964a150b" containerName="cleanup"
Jul 08 18:17:33.536999 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536981    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28874fe5-65b9-4db0-802e-eee62b5efe7e" containerName="cleanup"
Jul 08 18:17:33.536999 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.536989    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="28874fe5-65b9-4db0-802e-eee62b5efe7e" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537005    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3602ff6c-9fe6-4466-8b56-569f0713d38f" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537013    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3602ff6c-9fe6-4466-8b56-569f0713d38f" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537029    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9218061-4e94-480d-819a-12a42be6a014" containerName="maas-api"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537039    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9218061-4e94-480d-819a-12a42be6a014" containerName="maas-api"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537140    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3602ff6c-9fe6-4466-8b56-569f0713d38f" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537155    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9218061-4e94-480d-819a-12a42be6a014" containerName="maas-api"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537165    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="28874fe5-65b9-4db0-802e-eee62b5efe7e" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537177    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b3b5680-338d-4848-9a76-dee1964a150b" containerName="cleanup"
Jul 08 18:17:33.537251 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.537187    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="277be6b4-9e8b-44b5-83ba-702c1ac93ae1" containerName="maas-api"
Jul 08 18:17:33.541768 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.541747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.544244 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.544224    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzqzv\"/\"openshift-service-ca.crt\""
Jul 08 18:17:33.544358 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.544232    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vzqzv\"/\"default-dockercfg-68kf9\""
Jul 08 18:17:33.545129 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.545112    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzqzv\"/\"kube-root-ca.crt\""
Jul 08 18:17:33.549879 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.549858    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"]
Jul 08 18:17:33.680701 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.680665    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-podres\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.680701 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.680705    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2qzg\" (UniqueName: \"kubernetes.io/projected/5d1d4681-abfe-4ce9-946a-f2678888f034-kube-api-access-z2qzg\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.681004 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.680734    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-sys\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.681004 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.680773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-proc\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.681004 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.680861    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-lib-modules\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.781950 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.781914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-podres\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.781950 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.781952    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2qzg\" (UniqueName: \"kubernetes.io/projected/5d1d4681-abfe-4ce9-946a-f2678888f034-kube-api-access-z2qzg\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782178 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.781976    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-sys\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782178 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782090    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-proc\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782178 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782117    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-podres\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782178 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782136    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-sys\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782348 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782184    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-proc\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782348 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782202    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-lib-modules\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.782348 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.782335    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1d4681-abfe-4ce9-946a-f2678888f034-lib-modules\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.789897 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.789843    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2qzg\" (UniqueName: \"kubernetes.io/projected/5d1d4681-abfe-4ce9-946a-f2678888f034-kube-api-access-z2qzg\") pod \"perf-node-gather-daemonset-fcfjw\" (UID: \"5d1d4681-abfe-4ce9-946a-f2678888f034\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.852561 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.852530    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:33.983867 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:33.983645    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"]
Jul 08 18:17:33.986096 ip-10-0-141-215 kubenswrapper[2575]: W0708 18:17:33.986067    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5d1d4681_abfe_4ce9_946a_f2678888f034.slice/crio-d430e7d4c79d82e5776d1178920bb0dab04ee9572852c0aab481b93ffb8ce782 WatchSource:0}: Error finding container d430e7d4c79d82e5776d1178920bb0dab04ee9572852c0aab481b93ffb8ce782: Status 404 returned error can't find the container with id d430e7d4c79d82e5776d1178920bb0dab04ee9572852c0aab481b93ffb8ce782
Jul 08 18:17:34.108656 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:34.108620    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw" event={"ID":"5d1d4681-abfe-4ce9-946a-f2678888f034","Type":"ContainerStarted","Data":"f104dfa97eb4b523ac6262050da734558d0ac11da9da591c045070e21220ceae"}
Jul 08 18:17:34.108862 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:34.108680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw" event={"ID":"5d1d4681-abfe-4ce9-946a-f2678888f034","Type":"ContainerStarted","Data":"d430e7d4c79d82e5776d1178920bb0dab04ee9572852c0aab481b93ffb8ce782"}
Jul 08 18:17:34.108862 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:34.108742    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:34.127367 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:34.127312    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw" podStartSLOduration=1.127297074 podStartE2EDuration="1.127297074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:17:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:34.126440255 +0000 UTC m=+2642.992970293" watchObservedRunningTime="2026-07-08 18:17:34.127297074 +0000 UTC m=+2642.993827115"
Jul 08 18:17:36.372883 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:36.372852    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cg55p_e18cfa2f-899e-4ba0-bdf5-7396d8013b07/dns/0.log"
Jul 08 18:17:36.392897 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:36.392859    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cg55p_e18cfa2f-899e-4ba0-bdf5-7396d8013b07/kube-rbac-proxy/0.log"
Jul 08 18:17:36.513971 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:36.513943    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zjwjh_376e6366-2e23-47bd-90bb-af0d14c74f3c/dns-node-resolver/0.log"
Jul 08 18:17:37.066956 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:37.066923    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7644c96b88-z49vh_86ca89a8-5557-431a-8241-f01db8e5b0f3/registry/0.log"
Jul 08 18:17:37.086865 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:37.086837    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bmj4c_0a77fb5b-7fff-402b-b1a4-74d4e62e2729/node-ca/0.log"
Jul 08 18:17:38.227389 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:38.227355    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8pbkf_efd0b881-d4f4-47ec-9139-82acc02d3289/discovery/0.log"
Jul 08 18:17:38.276220 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:38.276190    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579f5c748-tgsjr_294e26c4-36d0-4825-874b-7e853656fede/kube-auth-proxy/0.log"
Jul 08 18:17:38.458660 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:38.458631    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cnzd_68bea353-a813-4d6f-88b6-cdefd72b8eae/payload-processing/0.log"
Jul 08 18:17:39.162544 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:39.162514    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-59x8z_b79db439-5c7f-45c3-aa04-5593d6e77f39/serve-healthcheck-canary/0.log"
Jul 08 18:17:39.822946 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:39.822916    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4dpg_0ad78ffa-9732-43f7-8e97-47529c976a22/kube-rbac-proxy/0.log"
Jul 08 18:17:39.845591 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:39.845561    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4dpg_0ad78ffa-9732-43f7-8e97-47529c976a22/exporter/0.log"
Jul 08 18:17:39.871761 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:39.871734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n4dpg_0ad78ffa-9732-43f7-8e97-47529c976a22/extractor/0.log"
Jul 08 18:17:40.122717 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:40.122692    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-fcfjw"
Jul 08 18:17:42.239078 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.239047    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-dfppr_4f3c477d-350e-4fac-9fb6-103f60850493/manager/0.log"
Jul 08 18:17:42.352568 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.352475    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-zwtv8_66e4fd13-6f84-4ba1-8446-1d8fe19e9b56/manager/0.log"
Jul 08 18:17:42.435373 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.435338    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f8df59f6f-jwzxj_59e17f33-aae1-475a-aaf8-0d7e8e318a67/manager/0.log"
Jul 08 18:17:42.458971 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.458945    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ghnqr_59b7dfd8-091f-48bf-8749-a41366449680/server/0.log"
Jul 08 18:17:42.520759 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.520734    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bpg98_10635e3c-f49f-4592-b7e7-d6d6c284db9c/manager/0.log"
Jul 08 18:17:42.691955 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.691917    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-lwvfv_a73b4be0-7617-4acc-becb-6610a33df643/manager/0.log"
Jul 08 18:17:42.710361 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:42.710335    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-lwvfv_a73b4be0-7617-4acc-becb-6610a33df643/copy-manifests/0.log"
Jul 08 18:17:44.008652 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:44.008614    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8pbkf_efd0b881-d4f4-47ec-9139-82acc02d3289/discovery/0.log"
Jul 08 18:17:44.033833 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:44.033805    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579f5c748-tgsjr_294e26c4-36d0-4825-874b-7e853656fede/kube-auth-proxy/0.log"
Jul 08 18:17:44.183316 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:44.183282    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cnzd_68bea353-a813-4d6f-88b6-cdefd72b8eae/payload-processing/0.log"
Jul 08 18:17:45.507234 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:45.507202    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-8pbkf_efd0b881-d4f4-47ec-9139-82acc02d3289/discovery/0.log"
Jul 08 18:17:45.539818 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:45.539767    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6579f5c748-tgsjr_294e26c4-36d0-4825-874b-7e853656fede/kube-auth-proxy/0.log"
Jul 08 18:17:45.695333 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:45.695298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4cnzd_68bea353-a813-4d6f-88b6-cdefd72b8eae/payload-processing/0.log"
Jul 08 18:17:50.452399 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:50.452369    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-62kbb_823def65-7540-403c-a855-1d027ce1a1de/kube-multus/0.log"
Jul 08 18:17:50.837012 ip-10-0-141-215 kubenswrapper[2575]: I0708 18:17:50.836933    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-thq8l_b829f001-c40d-4f7b-9e34-6edf82de7996/kube-multus-additional-cni-plugins/0.log"