Jul 21 00:16:53.549949 ip-10-0-141-120 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 00:16:53.849438 ip-10-0-141-120 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:16:53.849438 ip-10-0-141-120 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 00:16:53.849438 ip-10-0-141-120 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:16:53.849438 ip-10-0-141-120 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 00:16:53.850082 ip-10-0-141-120 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 00:16:53.850312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.850208    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 00:16:53.855205 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855190    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.855205 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855205    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855208    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855212    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855215    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855218    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855221    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855224    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855227    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855230    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855232    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855235    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855237    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855240    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855242    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855245    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855249    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855253    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855256    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855260    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.855268 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855263    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855265    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855268    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855270    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855273    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855276    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855279    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855281    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855284    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855287    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855289    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855292    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855295    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855297    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855299    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855302    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855304    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855307    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855309    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855311    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.855725 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855314    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855316    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855319    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855321    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855323    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855326    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855328    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855331    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855333    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855335    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855338    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855340    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855345    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855349    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855353    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855356    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855359    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855361    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855364    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.856199 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855366    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855369    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855371    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855373    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855376    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855379    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855381    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855384    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855387    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855391    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855393    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855396    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855400    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855403    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855406    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855409    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855411    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855414    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855416    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.856650 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855419    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855421    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855423    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855426    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855428    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855431    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855434    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855437    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855440    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855443    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855446    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855448    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855450    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855453    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855456    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855458    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855461    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855463    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855466    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855469    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.857124 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.855471    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856153    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856159    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856162    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856165    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856168    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856170    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856173    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856176    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856179    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856181    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856184    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856186    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856189    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856191    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856194    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856196    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856199    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856201    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856203    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.857591 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856208    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856212    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856214    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856218    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856223    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856226    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856228    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856231    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856233    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856236    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856238    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856241    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856243    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856246    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856248    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856251    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856253    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856256    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856259    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856261    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.858120 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856264    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856266    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856269    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856271    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856274    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856276    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856279    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856281    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856284    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856286    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856288    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856291    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856294    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856297    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856300    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856302    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856304    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856308    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856310    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856313    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.858593 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856315    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856318    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856320    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856323    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856325    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856327    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856330    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856332    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856335    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856338    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856342    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856345    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856348    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856350    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856353    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856356    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856359    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856361    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856364    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.859081 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856366    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856369    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856371    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856374    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856376    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856379    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856382    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856386    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856388    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856391    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856395    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856397    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856400    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856402    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856405    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856408    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856411    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856415    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856417    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.859538 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856420    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856422    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856799    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856805    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856808    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856811    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856814    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856816    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856819    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856821    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856824    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856826    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856829    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856831    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856834    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856836    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856839    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856841    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856844    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856847    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.860011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856850    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856853    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856855    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856858    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856861    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856863    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856867    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856870    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856872    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856874    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856877    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856880    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856882    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856885    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856887    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856890    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856892    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856894    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856897    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856900    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.860483 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856902    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856904    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856906    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856909    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856912    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856916    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856919    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856921    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856923    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856929    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856933    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856936    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856938    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856941    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856944    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856946    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856949    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856951    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856954    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.860981 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856956    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856958    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856961    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856963    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856966    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856968    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856971    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856973    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856975    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856977    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856980    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856983    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856986    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856988    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856991    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856993    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856995    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.856998    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857000    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857005    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.861440 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857008    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857011    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857016    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857018    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857021    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857023    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857026    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857029    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857031    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857034    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857036    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857038    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857041    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857043    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857046    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857048    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857051    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857053    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857055    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857059    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.861938 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857062    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857065    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857138    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857148    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857157    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857163    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857170    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857175    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857180    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857183    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857189    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857192    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857195    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857198    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857202    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857205    2576 flags.go:64] FLAG: --cgroup-root=""
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857208    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857210    2576 flags.go:64] FLAG: --client-ca-file=""
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857213    2576 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857216    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857220    2576 flags.go:64] FLAG: --cluster-domain=""
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857223    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857226    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857229    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 00:16:53.862404 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857233    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857243    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857246    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857249    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857252    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857254    2576 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857257    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857260    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857263    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857266    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857270    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857273    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857275    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857278    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857281    2576 flags.go:64] FLAG: --enable-server="true"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857284    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857288    2576 flags.go:64] FLAG: --event-burst="100"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857291    2576 flags.go:64] FLAG: --event-qps="50"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857295    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857298    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857300    2576 flags.go:64] FLAG: --eviction-hard=""
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857304    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857308    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857311    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857314    2576 flags.go:64] FLAG: --eviction-soft=""
Jul 21 00:16:53.863022 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857317    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857320    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857323    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857325    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857335    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857338    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857340    2576 flags.go:64] FLAG: --feature-gates=""
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857348    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857351    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857354    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857357    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857360    2576 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857363    2576 flags.go:64] FLAG: --help="false"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857365    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-141-120.ec2.internal"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857368    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857371    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857374    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857377    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857380    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857383    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857385    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857388    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857391    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 00:16:53.863632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857394    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857396    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857400    2576 flags.go:64] FLAG: --kube-reserved=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857403    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857406    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857408    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857412    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857415    2576 flags.go:64] FLAG: --lock-file=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857418    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857421    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857423    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857429    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857431    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857435    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857438    2576 flags.go:64] FLAG: --logging-format="text"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857441    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857444    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857446    2576 flags.go:64] FLAG: --manifest-url=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857449    2576 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857453    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857456    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857460    2576 flags.go:64] FLAG: --max-pods="110"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857463    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857466    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857468    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 00:16:53.864247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857471    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857474    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857477    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857480    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857486    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857489    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857492    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857495    2576 flags.go:64] FLAG: --pod-cidr=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857498    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857503    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857507    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857510    2576 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857513    2576 flags.go:64] FLAG: --port="10250"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857517    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857520    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00b9c66b0851446dc"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857523    2576 flags.go:64] FLAG: --qos-reserved=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857526    2576 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857528    2576 flags.go:64] FLAG: --register-node="true"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857531    2576 flags.go:64] FLAG: --register-with-taints=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857534    2576 flags.go:64] FLAG: --registry-burst="10"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857537    2576 flags.go:64] FLAG: --registry-qps="5"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857540    2576 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857543    2576 flags.go:64] FLAG: --reserved-memory=""
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857546    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857549    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 00:16:53.864878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857552    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857555    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857558    2576 flags.go:64] FLAG: --runonce="false"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857560    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857563    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857566    2576 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857569    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857572    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857574    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857577    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857580    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857583    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857585    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857588    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857591    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857594    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857597    2576 flags.go:64] FLAG: --system-cgroups=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857601    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857606    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857609    2576 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857612    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857615    2576 flags.go:64] FLAG: --tls-min-version=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857618    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857621    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857624    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 00:16:53.865682 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857626    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857629    2576 flags.go:64] FLAG: --v="2"
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857633    2576 flags.go:64] FLAG: --version="false"
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857637    2576 flags.go:64] FLAG: --vmodule=""
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857640    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.857644    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857768    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857772    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857775    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857778    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857782    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857785    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857788    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857791    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857794    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857797    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857800    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857803    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857805    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857808    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.866515 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857811    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857814    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857816    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857819    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857823    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857825    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857827    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857830    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857834    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857837    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857840    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857843    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857846    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857848    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857851    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857854    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857857    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857859    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857862    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857865    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.867036 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857867    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857869    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857872    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857875    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857877    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857879    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857882    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857885    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857887    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857889    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857892    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857894    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857897    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857900    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857902    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857904    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857908    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857911    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857913    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857916    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.867516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857918    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857921    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857923    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857926    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857928    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857931    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857933    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857935    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857938    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857941    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857943    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857946    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857949    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857951    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857954    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857956    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857958    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857961    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857963    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857966    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.868027 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857968    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857970    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857973    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857975    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857978    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857980    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857983    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857985    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857989    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857992    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857994    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.857997    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858000    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858002    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858005    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858007    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858009    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858012    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858014    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858017    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.868497 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858020    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858023    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858027    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858030    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.858032    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.858505    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.866785    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.866800    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.867384    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.867391    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867452    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867458    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867462    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867464    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867468    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.869011 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867470    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867473    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867476    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867480    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867484    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867487    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867490    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867493    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867495    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867498    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867506    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867509    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867512    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867514    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867517    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867519    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867522    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867525    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867528    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.869384 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867531    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867534    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867536    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867538    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867541    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867544    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867548    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867552    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867554    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867557    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867559    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867562    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867564    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867566    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867569    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867571    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867574    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867576    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867579    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867582    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.869992 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867585    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867588    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867597    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867600    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867603    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867605    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867608    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867611    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867614    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867616    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867619    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867621    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867624    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867627    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867629    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867632    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867635    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867637    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867640    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.870478 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867642    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867645    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867647    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867650    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867652    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867654    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867657    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867659    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867662    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867682    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867685    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867688    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867690    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867693    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867695    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867698    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867706    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867709    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867712    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867714    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.871022 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867717    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867719    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867721    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867723    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867726    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867728    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867731    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867733    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867736    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867739    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867742    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867744    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867747    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867749    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867751    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.871504 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867754    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.867759    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867873    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867879    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867882    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867885    2576 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867887    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867890    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867893    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867895    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867898    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867900    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867902    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867905    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867913    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 00:16:53.871884 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867916    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867919    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867921    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867924    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867926    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867928    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867931    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867933    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867935    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867938    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867941    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867944    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867946    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867948    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867951    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867953    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867956    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867959    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867961    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867963    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 00:16:53.872242 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867966    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867968    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867970    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867973    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867975    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867978    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867980    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867983    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867985    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867987    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867990    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.867994    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868003    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868006    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868009    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868012    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868015    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868018    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868020    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 00:16:53.872746 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868023    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868025    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868028    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868031    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868034    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868036    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868039    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868042    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868044    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868047    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868049    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868051    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868054    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868056    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868058    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868061    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868063    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868066    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868068    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 00:16:53.873198 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868071    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868073    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868075    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868078    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868080    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868083    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868086    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868094    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868096    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868099    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868102    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868104    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868106    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868109    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868111    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868115    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868117    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868120    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868122    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868124    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 00:16:53.873646 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868127    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868129    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868131    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868134    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868137    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868141    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868144    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:53.868146    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.868151    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.868254    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.871425    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.872538    2576 server.go:1019] "Starting client certificate rotation"
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.872642    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:16:53.874116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.872688    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 00:16:53.875401 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.875387    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:16:53.876864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.876844    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 00:16:53.886448 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.886432    2576 log.go:25] "Validated CRI v1 runtime API"
Jul 21 00:16:53.888306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.888291    2576 log.go:25] "Validated CRI v1 image API"
Jul 21 00:16:53.889137 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.889125    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 00:16:53.891274 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.891252    2576 fs.go:135] Filesystem UUIDs: map[71791b34-183a-436c-818d-70dbe093db3e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 903c232f-aa77-4fe0-bd1b-48d7a64e9186:/dev/nvme0n1p3]
Jul 21 00:16:53.891325 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.891274    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 00:16:53.896610 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.896497    2576 manager.go:216] Machine: {Timestamp:2026-07-21 00:16:53.895331806 +0000 UTC m=+0.253321037 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499992 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec201431207f83f47f8115a1be989e09 SystemUUID:ec201431-207f-83f4-7f81-15a1be989e09 BootID:8534da80-9b34-469d-a346-aba785970713 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:33:93:20:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:33:93:20:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:e1:5b:0a:4b:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 00:16:53.896610 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.896605    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 00:16:53.896743 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.896688    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 00:16:53.898046 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.898024    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 00:16:53.898182 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.898049    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 00:16:53.899167 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.899157    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 00:16:53.899205 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.899170    2576 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 00:16:53.899205 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.899178    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:16:53.899768 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.899756    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 00:16:53.899807 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.899776    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:16:53.900925 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.900913    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 00:16:53.903597 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903586    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:16:53.903781 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903771    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 00:16:53.903821 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903807    2576 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 00:16:53.903821 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903816    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 00:16:53.903877 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903826    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 00:16:53.903877 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903835    2576 kubelet.go:398] "Adding apiserver pod source"
Jul 21 00:16:53.903877 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.903844    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 00:16:53.904400 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.904377    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:16:53.904507 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.904421    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 00:16:53.908281 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.908257    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 00:16:53.909987 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.909975    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 00:16:53.910041 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.910004    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 00:16:53.911043 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911032    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911047    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911053    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911058    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911066    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911071    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911079    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911083    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911090    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 00:16:53.911096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911095    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 00:16:53.911367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911103    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 00:16:53.911367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911108    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 00:16:53.911690 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911662    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 00:16:53.911727 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.911691    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 00:16:53.914639 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.914624    2576 server.go:1268] "Started kubelet"
Jul 21 00:16:53.914795 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.914745    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 00:16:53.914899 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.914885    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 00:16:53.914952 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.914936    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 00:16:53.915519 ip-10-0-141-120 systemd[1]: Started Kubernetes Kubelet.
Jul 21 00:16:53.916602 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.916497    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 00:16:53.916901 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.916872    2576 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 00:16:53.916966 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.916867    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 00:16:53.917134 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.917113    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 00:16:53.917355 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.917336    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 00:16:53.920959 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.920939    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 00:16:53.921604 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.920884    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-120.ec2.internal.18c425e41705ff28  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-120.ec2.internal,UID:ip-10-0-141-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-120.ec2.internal,},FirstTimestamp:2026-07-21 00:16:53.914599208 +0000 UTC m=+0.272588440,LastTimestamp:2026-07-21 00:16:53.914599208 +0000 UTC m=+0.272588440,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-120.ec2.internal,}"
Jul 21 00:16:53.923291 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.923278    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 00:16:53.923355 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.923299    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 00:16:53.923531 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.923513    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:53.923855 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.923837    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 00:16:53.923942 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.923872    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 00:16:53.923942 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.923894    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 00:16:53.924040 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924020    2576 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 00:16:53.924040 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924028    2576 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 00:16:53.924195 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924176    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 00:16:53.924195 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924196    2576 factory.go:55] Registering systemd factory
Jul 21 00:16:53.924324 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924205    2576 factory.go:223] Registration of the systemd container factory successfully
Jul 21 00:16:53.924445 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924432    2576 factory.go:153] Registering CRI-O factory
Jul 21 00:16:53.924445 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924445    2576 factory.go:223] Registration of the crio container factory successfully
Jul 21 00:16:53.924555 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924463    2576 factory.go:103] Registering Raw factory
Jul 21 00:16:53.924555 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924473    2576 manager.go:1196] Started watching for new ooms in manager
Jul 21 00:16:53.924846 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.924830    2576 manager.go:349] Starting recovery of all containers
Jul 21 00:16:53.926639 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.926372    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8lc9v"
Jul 21 00:16:53.930181 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.930153    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 00:16:53.930294 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.930273    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 00:16:53.932865 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.932827    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8lc9v"
Jul 21 00:16:53.938312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.938295    2576 manager.go:354] Recovery completed
Jul 21 00:16:53.942355 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.942343    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:53.944183 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944164    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:53.944248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944201    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:53.944248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944217    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:53.944633 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944619    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 00:16:53.944633 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944633    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 00:16:53.944785 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944647    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:53.944785 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.944650    2576 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 00:16:53.945317 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945301    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:53.945367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945329    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:53.945367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945339    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:53.945767 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945754    2576 policy_none.go:49] "None policy: Start"
Jul 21 00:16:53.945818 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945773    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 00:16:53.945818 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.945786    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 00:16:53.946345 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.946287    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-120.ec2.internal.18c425e418c96a7f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-120.ec2.internal,UID:ip-10-0-141-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-120.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-120.ec2.internal,},FirstTimestamp:2026-07-21 00:16:53.944183423 +0000 UTC m=+0.302172660,LastTimestamp:2026-07-21 00:16:53.944183423 +0000 UTC m=+0.302172660,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-120.ec2.internal,}"
Jul 21 00:16:53.946794 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.946782    2576 policy_none.go:47] "Start"
Jul 21 00:16:53.985336 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985207    2576 manager.go:337] "Starting Device Plugin manager"
Jul 21 00:16:53.985425 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.985359    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 00:16:53.985425 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985372    2576 server.go:87] "Starting device plugin registration server"
Jul 21 00:16:53.985586 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985575    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 00:16:53.985619 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985590    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 00:16:53.985727 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985706    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 00:16:53.985802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985787    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 00:16:53.985802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:53.985799    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 00:16:53.986281 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.986251    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 00:16:53.986345 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:53.986315    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.072155 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.072125    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 00:16:54.074212 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.073414    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 00:16:54.074212 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.073445    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 00:16:54.074212 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.073464    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 00:16:54.074212 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.073491    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 00:16:54.075439 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.075422    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:54.086469 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.086442    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:54.087362 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.087340    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:54.087443 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.087368    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:54.087443 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.087377    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:54.087443 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.087403    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.095624 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.095609    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.095727 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.095631    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-120.ec2.internal\": node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.115933 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.115889    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.174268 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.174250    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"]
Jul 21 00:16:54.174324 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.174308    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:54.175712 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.175698    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:54.175806 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.175720    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:54.175806 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.175733    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:54.177802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.177790    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:54.177906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.177894    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.177948 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.177924    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:54.178437 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178420    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:54.178522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178447    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:54.178522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178460    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:54.178522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178426    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:54.178522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178521    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:54.178724 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.178535    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:54.181039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.181022    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.181106 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.181056    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 00:16:54.181647 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.181631    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 00:16:54.181746 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.181678    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 00:16:54.181746 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.181694    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeHasSufficientPID"
Jul 21 00:16:54.207148 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.207129    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-120.ec2.internal\" not found" node="ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.211269 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.211248    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-120.ec2.internal\" not found" node="ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.216306 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.216292    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.225974 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.225958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.226019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.225995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.226019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.226012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bded2ed6bb26343f6cb8a89495340f4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-120.ec2.internal\" (UID: \"1bded2ed6bb26343f6cb8a89495340f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.317312 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.317293    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.327095 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327078    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.327158 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.327158 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327116    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bded2ed6bb26343f6cb8a89495340f4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-120.ec2.internal\" (UID: \"1bded2ed6bb26343f6cb8a89495340f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.327158 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327141    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1bded2ed6bb26343f6cb8a89495340f4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-120.ec2.internal\" (UID: \"1bded2ed6bb26343f6cb8a89495340f4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.327251 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.327251 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.327177    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f216092c62580edcf5f9f192677fb05d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal\" (UID: \"f216092c62580edcf5f9f192677fb05d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.417509 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.417464    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.509985 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.509959    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.513601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.513589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.518422 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.518404    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.618919 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.618890    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.719382 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.719340    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-120.ec2.internal\" not found"
Jul 21 00:16:54.761864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.761841    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:54.823694 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.823658    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.834053 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.834037    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:16:54.835522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.835510    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"
Jul 21 00:16:54.841023 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.841002    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 00:16:54.872199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.872185    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 00:16:54.872521 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.872273    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 00:16:54.872521 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.872324    2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 00:16:54.904473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.904458    2576 apiserver.go:52] "Watching apiserver"
Jul 21 00:16:54.917983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.917965    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 00:16:54.918310 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.918292    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z","openshift-dns/node-resolver-n8wsn","openshift-image-registry/node-ca-ldgww","openshift-multus/multus-cdtfx","openshift-multus/network-metrics-daemon-h8lxz","openshift-cluster-node-tuning-operator/tuned-2thjl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal","openshift-multus/multus-additional-cni-plugins-9h5cf","openshift-network-diagnostics/network-check-target-ldmkz","openshift-network-operator/iptables-alerter-q8gxv","openshift-ovn-kubernetes/ovnkube-node-c74q9","kube-system/global-pull-secret-syncer-w8vwz","kube-system/konnectivity-agent-nlnh6","kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal"]
Jul 21 00:16:54.919108 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.919093    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:54.921150 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.921131    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.923642 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.923360    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 00:16:54.923809 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.923789    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.923896 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.923883    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqj8k\""
Jul 21 00:16:54.923959 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.923899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:54.923959 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.923946    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 00:16:54.924806 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.924788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 00:16:54.924898 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.924826    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 00:16:54.924898 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.924893    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.925568 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.925553    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.926306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.926290    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.926373 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.926290    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jwmlj\""
Jul 21 00:16:54.926625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.926613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:54.928491 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.928473    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.928551 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.928473    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ncz79\""
Jul 21 00:16:54.928551 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.928479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 00:16:54.928551 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.928479    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.928870 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.928858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:54.930303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930374 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930374 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg885\" (UniqueName: \"kubernetes.io/projected/7ace5bb2-c537-4536-85b6-0b614b9c39ca-kube-api-access-vg885\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930374 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d6adef2-337e-422e-9537-d0838d2c92c1-serviceca\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:54.930497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cnibin\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-os-release\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5a13f9-59ec-4300-9180-adeebf1a09e1-hosts-file\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:54.930497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kq49\" (UniqueName: \"kubernetes.io/projected/bb5a13f9-59ec-4300-9180-adeebf1a09e1-kube-api-access-2kq49\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d6adef2-337e-422e-9537-d0838d2c92c1-host\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930533    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkpfr\" (UniqueName: \"kubernetes.io/projected/4d6adef2-337e-422e-9537-d0838d2c92c1-kube-api-access-gkpfr\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930559    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930629    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5a13f9-59ec-4300-9180-adeebf1a09e1-tmp-dir\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930650    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 00:16:54.930702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930651    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-system-cni-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:54.931000 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.930987    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:54.931060 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.931045    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:16:54.931109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931050    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 00:16:54.931109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931093    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.931441 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931425    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 00:16:54.931484 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931475    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 00:16:54.931515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931496    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m4s68\""
Jul 21 00:16:54.931584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.931571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.933069 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.933053    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:54.934825 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.934811    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-cnhz2\""
Jul 21 00:16:54.934896 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.934842    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 00:16:54.935031 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.935018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.935153 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.935140    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.935380 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.935369    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:54.936617 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.936597    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 00:11:54 +0000 UTC" deadline="2028-02-15 07:53:10.262639285 +0000 UTC"
Jul 21 00:16:54.936690 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.936617    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13783h36m15.326024521s"
Jul 21 00:16:54.937181 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.937164    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.937224 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.937198    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.937224 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.937219    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pbhtq\""
Jul 21 00:16:54.937293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.937264    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 00:16:54.937640 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.937628    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:54.939467 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.939451    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-h49pd\""
Jul 21 00:16:54.939526 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.939451    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 00:16:54.939896 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.939883    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:54.939953 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.939931    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:16:54.942916 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.942900    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:54.944776 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.944760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 00:16:54.944881 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.944808    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 00:16:54.944943 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.944910    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 00:16:54.945021 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.945006    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hjml\""
Jul 21 00:16:54.945201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.945185    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:54.945261 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:54.945244    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:16:54.947316 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.947301    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:54.949132 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.949113    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 00:16:54.949205 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.949153    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-22jnk\""
Jul 21 00:16:54.949241 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.949154    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 00:16:54.961133 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.961111    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jkx8j"
Jul 21 00:16:54.968383 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:54.968366    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jkx8j"
Jul 21 00:16:55.024813 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.024795    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 00:16:55.031659 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031637    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.031769 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031723    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-registration-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.031769 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-device-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.031869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.031869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-systemd\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.031869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031846    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-iptables-alerter-script\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.031989 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-system-cni-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.031989 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-log-socket\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.031989 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-bin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.031989 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031970    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-host\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.031997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-node-log\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032038    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-hostroot\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032065    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kq49\" (UniqueName: \"kubernetes.io/projected/bb5a13f9-59ec-4300-9180-adeebf1a09e1-kube-api-access-2kq49\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d6adef2-337e-422e-9537-d0838d2c92c1-host\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-kubelet\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032152 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-var-lib-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032172    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-config\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032243    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-env-overrides\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-system-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.032330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-etc-kubernetes\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-os-release\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032355    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-k8s-cni-cncf-io\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032378    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032412    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-tmp\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l9cz\" (UniqueName: \"kubernetes.io/projected/a6da106b-9733-45b1-81f1-e67784d43c1e-kube-api-access-2l9cz\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.032466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d6adef2-337e-422e-9537-d0838d2c92c1-host\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032471    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-kubelet-config\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-dbus\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-system-cni-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e22b50-c889-4f00-bace-83910f1a4bca-ovn-node-metrics-cert\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-slash\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.032709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnt5w\" (UniqueName: \"kubernetes.io/projected/79e22b50-c889-4f00-bace-83910f1a4bca-kube-api-access-pnt5w\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.033001 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033001 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032785    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:55.033001 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-var-lib-kubelet\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.033001 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032895    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.033001 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.032975    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-multus-certs\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-socket-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-lib-modules\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033124    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-host-slash\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/323fc16c-0d59-4d38-85da-04e3672d279b-konnectivity-ca\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5a13f9-59ec-4300-9180-adeebf1a09e1-tmp-dir\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033210    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-kubelet\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033293 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033289    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-tuned\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg885\" (UniqueName: \"kubernetes.io/projected/7ace5bb2-c537-4536-85b6-0b614b9c39ca-kube-api-access-vg885\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-netns\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-conf-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb5a13f9-59ec-4300-9180-adeebf1a09e1-tmp-dir\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033494    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8b6\" (UniqueName: \"kubernetes.io/projected/6de09419-6605-46c9-bc39-24dd00128d61-kube-api-access-zm8b6\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-modprobe-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-kubernetes\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-os-release\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-systemd-units\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-systemd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033700    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-etc-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033706    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-os-release\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033724    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cnibin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-socket-dir-parent\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cni-binary-copy\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.033827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033818    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-multus\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033860    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-daemon-config\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033889    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7jqf\" (UniqueName: \"kubernetes.io/projected/07bed11e-0c3c-4aae-981f-8d442585de95-kube-api-access-j7jqf\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033939    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysconfig\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-sys\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.033988    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-bin\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-script-lib\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034044    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cni-binary-copy\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034070    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl6gl\" (UniqueName: \"kubernetes.io/projected/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-kube-api-access-rl6gl\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-sys-fs\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034144    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034165    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-run\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d6adef2-337e-422e-9537-d0838d2c92c1-serviceca\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-netns\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.034598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-conf\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034262    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbj4r\" (UniqueName: \"kubernetes.io/projected/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-kube-api-access-nbj4r\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034290    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/323fc16c-0d59-4d38-85da-04e3672d279b-agent-certs\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-ovn\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034361    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cnibin\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5a13f9-59ec-4300-9180-adeebf1a09e1-hosts-file\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7ace5bb2-c537-4536-85b6-0b614b9c39ca-cnibin\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkpfr\" (UniqueName: \"kubernetes.io/projected/4d6adef2-337e-422e-9537-d0838d2c92c1-kube-api-access-gkpfr\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bb5a13f9-59ec-4300-9180-adeebf1a09e1-hosts-file\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034578    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-netd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.035100 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.034579    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d6adef2-337e-422e-9537-d0838d2c92c1-serviceca\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.041563 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.041543    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 00:16:55.044762 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.044733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkpfr\" (UniqueName: \"kubernetes.io/projected/4d6adef2-337e-422e-9537-d0838d2c92c1-kube-api-access-gkpfr\") pod \"node-ca-ldgww\" (UID: \"4d6adef2-337e-422e-9537-d0838d2c92c1\") " pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.044858 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.044742    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kq49\" (UniqueName: \"kubernetes.io/projected/bb5a13f9-59ec-4300-9180-adeebf1a09e1-kube-api-access-2kq49\") pod \"node-resolver-n8wsn\" (UID: \"bb5a13f9-59ec-4300-9180-adeebf1a09e1\") " pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.044917 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.044898    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg885\" (UniqueName: \"kubernetes.io/projected/7ace5bb2-c537-4536-85b6-0b614b9c39ca-kube-api-access-vg885\") pod \"multus-additional-cni-plugins-9h5cf\" (UID: \"7ace5bb2-c537-4536-85b6-0b614b9c39ca\") " pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.135419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135399    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-netd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.135510 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-registration-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.135510 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135441    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-device-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.135510 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.135510 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-systemd\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135515    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-systemd\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135519    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-netd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135529    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-device-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-iptables-alerter-script\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135556    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-registration-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.135575    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135599    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-log-socket\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-log-socket\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.135649 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.135638    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:55.635622549 +0000 UTC m=+1.993611766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-bin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-host\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135712    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-node-log\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135726    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-hostroot\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135741    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-kubelet\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-var-lib-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135781    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-kubelet\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-host\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135817    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-node-log\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135797    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-config\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135829    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-var-lib-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135792    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-hostroot\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135839    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-bin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-env-overrides\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135930    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-system-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-etc-kubernetes\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.135980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-os-release\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.136103 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-k8s-cni-cncf-io\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136022    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-system-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136030    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-tmp\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136075    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l9cz\" (UniqueName: \"kubernetes.io/projected/a6da106b-9733-45b1-81f1-e67784d43c1e-kube-api-access-2l9cz\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136079    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-os-release\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136100    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-kubelet-config\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136106    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-iptables-alerter-script\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136117    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-etc-kubernetes\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-dbus\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136147    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e22b50-c889-4f00-bace-83910f1a4bca-ovn-node-metrics-cert\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136169    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-kubelet-config\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136170    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-slash\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnt5w\" (UniqueName: \"kubernetes.io/projected/79e22b50-c889-4f00-bace-83910f1a4bca-kube-api-access-pnt5w\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137135 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-env-overrides\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-var-lib-kubelet\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-k8s-cni-cncf-io\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136314    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-config\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136325    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.136400    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-etc-selinux\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.136451    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:55.63643478 +0000 UTC m=+1.994424015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136448    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136448    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-cni-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136464    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-slash\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-multus-certs\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136500    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-socket-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-lib-modules\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/49f64862-b311-47a6-b22e-6de917d42ec8-dbus\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.137955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-multus-certs\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136591    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-var-lib-kubelet\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-socket-dir\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136713    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-lib-modules\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-host-slash\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136864    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/323fc16c-0d59-4d38-85da-04e3672d279b-konnectivity-ca\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-kubelet\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-tuned\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-host-slash\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-netns\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-conf-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.136976    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-kubelet\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137013    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-run-netns\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-conf-dir\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8b6\" (UniqueName: \"kubernetes.io/projected/6de09419-6605-46c9-bc39-24dd00128d61-kube-api-access-zm8b6\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-modprobe-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-kubernetes\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-systemd-units\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.138737 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137171    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-systemd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-etc-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-modprobe-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cnibin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137264    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-socket-dir-parent\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137289    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-kubernetes\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-multus\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-etc-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137332    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-systemd-units\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137348    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-daemon-config\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7jqf\" (UniqueName: \"kubernetes.io/projected/07bed11e-0c3c-4aae-981f-8d442585de95-kube-api-access-j7jqf\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137378    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-systemd\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137394    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/323fc16c-0d59-4d38-85da-04e3672d279b-konnectivity-ca\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cnibin\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137400    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysconfig\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137426    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-host-var-lib-cni-multus\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137451    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysconfig\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137440    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-sys\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-socket-dir-parent\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-bin\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-script-lib\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-sys\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cni-binary-copy\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137581    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-cni-bin\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl6gl\" (UniqueName: \"kubernetes.io/projected/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-kube-api-access-rl6gl\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-sys-fs\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137793    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137820    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-run\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137849    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-netns\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137877    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-conf\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137905    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbj4r\" (UniqueName: \"kubernetes.io/projected/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-kube-api-access-nbj4r\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/323fc16c-0d59-4d38-85da-04e3672d279b-agent-certs\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.137964    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-ovn\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.139878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79e22b50-c889-4f00-bace-83910f1a4bca-ovnkube-script-lib\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138109    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-ovn-kubernetes\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-cni-binary-copy\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-run\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138284    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-d\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/07bed11e-0c3c-4aae-981f-8d442585de95-sys-fs\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-openvswitch\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138344    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-run-ovn\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79e22b50-c889-4f00-bace-83910f1a4bca-host-run-netns\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-sysctl-conf\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-multus-daemon-config\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-tmp\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.138759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79e22b50-c889-4f00-bace-83910f1a4bca-ovn-node-metrics-cert\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.139162    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6da106b-9733-45b1-81f1-e67784d43c1e-etc-tuned\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.140560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.140245    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/323fc16c-0d59-4d38-85da-04e3672d279b-agent-certs\") pod \"konnectivity-agent-nlnh6\" (UID: \"323fc16c-0d59-4d38-85da-04e3672d279b\") " pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.142818 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.142787    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf216092c62580edcf5f9f192677fb05d.slice/crio-9011cb790b1a75c18151d49be38597fef2958e94aa99a2454d6c57c87313c697 WatchSource:0}: Error finding container 9011cb790b1a75c18151d49be38597fef2958e94aa99a2454d6c57c87313c697: Status 404 returned error can't find the container with id 9011cb790b1a75c18151d49be38597fef2958e94aa99a2454d6c57c87313c697
Jul 21 00:16:55.147205 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.147193    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:16:55.148733 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.148715    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:16:55.148733 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.148735    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:16:55.148848 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.148744    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:55.148890 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.148859    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:55.648838616 +0000 UTC m=+2.006827852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:55.150143 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.150116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l9cz\" (UniqueName: \"kubernetes.io/projected/a6da106b-9733-45b1-81f1-e67784d43c1e-kube-api-access-2l9cz\") pod \"tuned-2thjl\" (UID: \"a6da106b-9733-45b1-81f1-e67784d43c1e\") " pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.150998 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.150975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8b6\" (UniqueName: \"kubernetes.io/projected/6de09419-6605-46c9-bc39-24dd00128d61-kube-api-access-zm8b6\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.151257 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.151233    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbj4r\" (UniqueName: \"kubernetes.io/projected/791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90-kube-api-access-nbj4r\") pod \"iptables-alerter-q8gxv\" (UID: \"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90\") " pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.151996 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.151979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnt5w\" (UniqueName: \"kubernetes.io/projected/79e22b50-c889-4f00-bace-83910f1a4bca-kube-api-access-pnt5w\") pod \"ovnkube-node-c74q9\" (UID: \"79e22b50-c889-4f00-bace-83910f1a4bca\") " pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.152383 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.152368    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7jqf\" (UniqueName: \"kubernetes.io/projected/07bed11e-0c3c-4aae-981f-8d442585de95-kube-api-access-j7jqf\") pod \"aws-ebs-csi-driver-node-n6z9z\" (UID: \"07bed11e-0c3c-4aae-981f-8d442585de95\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.152886 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.152869    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl6gl\" (UniqueName: \"kubernetes.io/projected/f24a7e14-6fc2-45ab-b6de-4f5ba383d179-kube-api-access-rl6gl\") pod \"multus-cdtfx\" (UID: \"f24a7e14-6fc2-45ab-b6de-4f5ba383d179\") " pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.264780 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.264753    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9h5cf"
Jul 21 00:16:55.276015 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.275994    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ace5bb2_c537_4536_85b6_0b614b9c39ca.slice/crio-6ca18ab7ff4e9bcd1c56f5fff096a5696cef0bb7e593302aee0cf59e0b49fe6b WatchSource:0}: Error finding container 6ca18ab7ff4e9bcd1c56f5fff096a5696cef0bb7e593302aee0cf59e0b49fe6b: Status 404 returned error can't find the container with id 6ca18ab7ff4e9bcd1c56f5fff096a5696cef0bb7e593302aee0cf59e0b49fe6b
Jul 21 00:16:55.280256 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.280238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8wsn"
Jul 21 00:16:55.288458 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.288437    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5a13f9_59ec_4300_9180_adeebf1a09e1.slice/crio-067c932595e8482f9c5178cac3c6938a078c7544ed4a02442a4574c0795ad5eb WatchSource:0}: Error finding container 067c932595e8482f9c5178cac3c6938a078c7544ed4a02442a4574c0795ad5eb: Status 404 returned error can't find the container with id 067c932595e8482f9c5178cac3c6938a078c7544ed4a02442a4574c0795ad5eb
Jul 21 00:16:55.291581 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.291567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ldgww"
Jul 21 00:16:55.299432 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.299414    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6adef2_337e_422e_9537_d0838d2c92c1.slice/crio-d4f5f5920be8c77b1200b276b1d74507e85f2fd95e8c39607bd46b6937e7a1fb WatchSource:0}: Error finding container d4f5f5920be8c77b1200b276b1d74507e85f2fd95e8c39607bd46b6937e7a1fb: Status 404 returned error can't find the container with id d4f5f5920be8c77b1200b276b1d74507e85f2fd95e8c39607bd46b6937e7a1fb
Jul 21 00:16:55.308866 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.308848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:16:55.312800 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.312775    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2thjl"
Jul 21 00:16:55.317252 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.317236    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e22b50_c889_4f00_bace_83910f1a4bca.slice/crio-bd4cc483089af86954ed5e0d32d562dc4d1acc87ca8c8be9e63d9d5c9d03ba58 WatchSource:0}: Error finding container bd4cc483089af86954ed5e0d32d562dc4d1acc87ca8c8be9e63d9d5c9d03ba58: Status 404 returned error can't find the container with id bd4cc483089af86954ed5e0d32d562dc4d1acc87ca8c8be9e63d9d5c9d03ba58
Jul 21 00:16:55.322241 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.322223    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6da106b_9733_45b1_81f1_e67784d43c1e.slice/crio-a1d066d91686ee6e4dcb8d6ae9ad5d03957d8471eaae2914936e58f6aaddaa05 WatchSource:0}: Error finding container a1d066d91686ee6e4dcb8d6ae9ad5d03957d8471eaae2914936e58f6aaddaa05: Status 404 returned error can't find the container with id a1d066d91686ee6e4dcb8d6ae9ad5d03957d8471eaae2914936e58f6aaddaa05
Jul 21 00:16:55.331789 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.331773    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q8gxv"
Jul 21 00:16:55.340651 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.340633    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791bc4bf_d3ba_4eb2_ba86_5d16ccfb2d90.slice/crio-8adf88a9a23d6c77e13f22ffb10a80dbe532a9ced746c5e6f40e4c4f130bb346 WatchSource:0}: Error finding container 8adf88a9a23d6c77e13f22ffb10a80dbe532a9ced746c5e6f40e4c4f130bb346: Status 404 returned error can't find the container with id 8adf88a9a23d6c77e13f22ffb10a80dbe532a9ced746c5e6f40e4c4f130bb346
Jul 21 00:16:55.344802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.344786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cdtfx"
Jul 21 00:16:55.353434 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.353414    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf24a7e14_6fc2_45ab_b6de_4f5ba383d179.slice/crio-a3496b96d80155f74316f13eead60e625e2de515abe2331fe388ec9a89eaac4a WatchSource:0}: Error finding container a3496b96d80155f74316f13eead60e625e2de515abe2331fe388ec9a89eaac4a: Status 404 returned error can't find the container with id a3496b96d80155f74316f13eead60e625e2de515abe2331fe388ec9a89eaac4a
Jul 21 00:16:55.370957 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.370926    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z"
Jul 21 00:16:55.377047 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.377032    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:16:55.379377 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.379353    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bed11e_0c3c_4aae_981f_8d442585de95.slice/crio-9e4efcacafa0a789bbf2b34c0b4786e6e1efd9e3c069b057d92cd1314cdd00ff WatchSource:0}: Error finding container 9e4efcacafa0a789bbf2b34c0b4786e6e1efd9e3c069b057d92cd1314cdd00ff: Status 404 returned error can't find the container with id 9e4efcacafa0a789bbf2b34c0b4786e6e1efd9e3c069b057d92cd1314cdd00ff
Jul 21 00:16:55.387102 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:55.387078    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod323fc16c_0d59_4d38_85da_04e3672d279b.slice/crio-c81904f45540380ab08eedb3c74b452cb6caf1b6ddb735c9fc7996d7f9b7d7fd WatchSource:0}: Error finding container c81904f45540380ab08eedb3c74b452cb6caf1b6ddb735c9fc7996d7f9b7d7fd: Status 404 returned error can't find the container with id c81904f45540380ab08eedb3c74b452cb6caf1b6ddb735c9fc7996d7f9b7d7fd
Jul 21 00:16:55.451364 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.451332    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:55.641937 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.641868    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:55.642074 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.641934    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:55.642074 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.642053    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:55.642159 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.642120    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:56.642098499 +0000 UTC m=+3.000087738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:55.642159 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.642053    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:55.642245 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.642191    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:56.642177651 +0000 UTC m=+3.000166871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:55.742920 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.742885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:55.743070 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.743015    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:16:55.743070 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.743028    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:16:55.743070 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.743040    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:55.743240 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:55.743081    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:56.743067549 +0000 UTC m=+3.101056769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:55.808969 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.808938    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:55.971818 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.971712    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:11:55 +0000 UTC" deadline="2028-03-26 11:30:36.640060201 +0000 UTC"
Jul 21 00:16:55.971818 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:55.971759    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14747h13m40.66830698s"
Jul 21 00:16:56.030421 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:16:56.030383    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bded2ed6bb26343f6cb8a89495340f4.slice/crio-746b6c73d39b8f750377b14746fd522e2f5dc98b034d7e04beaa9a134e44e15c WatchSource:0}: Error finding container 746b6c73d39b8f750377b14746fd522e2f5dc98b034d7e04beaa9a134e44e15c: Status 404 returned error can't find the container with id 746b6c73d39b8f750377b14746fd522e2f5dc98b034d7e04beaa9a134e44e15c
Jul 21 00:16:56.074376 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.074340    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:56.074504 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.074477    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:16:56.074929 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.074898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:56.075041 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.075020    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:16:56.095380 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.095331    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlnh6" event={"ID":"323fc16c-0d59-4d38-85da-04e3672d279b","Type":"ContainerStarted","Data":"c81904f45540380ab08eedb3c74b452cb6caf1b6ddb735c9fc7996d7f9b7d7fd"}
Jul 21 00:16:56.114705 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.114625    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z" event={"ID":"07bed11e-0c3c-4aae-981f-8d442585de95","Type":"ContainerStarted","Data":"9e4efcacafa0a789bbf2b34c0b4786e6e1efd9e3c069b057d92cd1314cdd00ff"}
Jul 21 00:16:56.122497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.122469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8gxv" event={"ID":"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90","Type":"ContainerStarted","Data":"8adf88a9a23d6c77e13f22ffb10a80dbe532a9ced746c5e6f40e4c4f130bb346"}
Jul 21 00:16:56.131763 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.130838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2thjl" event={"ID":"a6da106b-9733-45b1-81f1-e67784d43c1e","Type":"ContainerStarted","Data":"a1d066d91686ee6e4dcb8d6ae9ad5d03957d8471eaae2914936e58f6aaddaa05"}
Jul 21 00:16:56.133712 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.133681    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerStarted","Data":"6ca18ab7ff4e9bcd1c56f5fff096a5696cef0bb7e593302aee0cf59e0b49fe6b"}
Jul 21 00:16:56.137530 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.137443    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal" event={"ID":"f216092c62580edcf5f9f192677fb05d","Type":"ContainerStarted","Data":"9011cb790b1a75c18151d49be38597fef2958e94aa99a2454d6c57c87313c697"}
Jul 21 00:16:56.144609 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.144584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdtfx" event={"ID":"f24a7e14-6fc2-45ab-b6de-4f5ba383d179","Type":"ContainerStarted","Data":"a3496b96d80155f74316f13eead60e625e2de515abe2331fe388ec9a89eaac4a"}
Jul 21 00:16:56.147227 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.147171    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"bd4cc483089af86954ed5e0d32d562dc4d1acc87ca8c8be9e63d9d5c9d03ba58"}
Jul 21 00:16:56.156496 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.156468    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ldgww" event={"ID":"4d6adef2-337e-422e-9537-d0838d2c92c1","Type":"ContainerStarted","Data":"d4f5f5920be8c77b1200b276b1d74507e85f2fd95e8c39607bd46b6937e7a1fb"}
Jul 21 00:16:56.159919 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.159868    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8wsn" event={"ID":"bb5a13f9-59ec-4300-9180-adeebf1a09e1","Type":"ContainerStarted","Data":"067c932595e8482f9c5178cac3c6938a078c7544ed4a02442a4574c0795ad5eb"}
Jul 21 00:16:56.162545 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.162513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal" event={"ID":"1bded2ed6bb26343f6cb8a89495340f4","Type":"ContainerStarted","Data":"746b6c73d39b8f750377b14746fd522e2f5dc98b034d7e04beaa9a134e44e15c"}
Jul 21 00:16:56.653330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.653292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:56.653518 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.653374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:56.653518 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.653513    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:56.653637 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.653580    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:58.653559274 +0000 UTC m=+5.011548505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:56.654042 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.654020    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:56.654158 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.654080    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:58.654062934 +0000 UTC m=+5.012052158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:56.754094 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.754057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:56.754254 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.754238    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:16:56.754313 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.754261    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:16:56.754313 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.754275    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:56.754476 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:56.754351    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:16:58.75433207 +0000 UTC m=+5.112321312 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:56.831816 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.831784    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 00:16:56.972475 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.972365    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 00:11:55 +0000 UTC" deadline="2027-12-16 20:48:01.764352151 +0000 UTC"
Jul 21 00:16:56.972475 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:56.972427    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12332h31m4.7919296s"
Jul 21 00:16:57.074132 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:57.074100    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:57.074371 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:57.074337    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:16:58.081073 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:58.080568    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:58.081073 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.080709    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:16:58.081073 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:58.080770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:58.081073 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.080906    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:58.672140    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:58.672224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.672355    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.672423    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:02.672401768 +0000 UTC m=+9.030390987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.672858    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:58.672939 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.672910    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:02.672897719 +0000 UTC m=+9.030886938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:16:58.773348 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:58.772711    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:58.773348 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.772908    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:16:58.773348 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.772929    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:16:58.773348 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.772945    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:58.773348 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:58.773004    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:02.772985687 +0000 UTC m=+9.130974911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:16:59.074067 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:16:59.073969    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:16:59.074217 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:16:59.074108    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:00.074858 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:00.074821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:00.075344 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:00.075023    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:00.075344 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:00.075049    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:00.075344 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:00.075178    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:01.074008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:01.073965    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:01.074189 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:01.074103    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:02.074883 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:02.074848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:02.075358 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.075016    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:02.075358 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:02.075062    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:02.075358 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.075148    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:02.708765 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:02.708727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:02.708924 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:02.708811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:02.708968 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.708933    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:02.709005 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.708955    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:02.709036 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.709022    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:10.709000579 +0000 UTC m=+17.066989812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:02.709078 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.709046    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:10.709034853 +0000 UTC m=+17.067024083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:02.810069 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:02.810028    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:02.810264 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.810181    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:17:02.810264 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.810202    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:17:02.810264 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.810215    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:02.810428 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:02.810287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:10.810267102 +0000 UTC m=+17.168256323 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:03.073839 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:03.073760    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:03.074009 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:03.073894    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:04.074856 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:04.074821    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:04.075343 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:04.074951    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:04.075343 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:04.075033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:04.075343 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:04.075137    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:05.074224 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:05.074182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:05.074419 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:05.074317    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:06.074891 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:06.074809    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:06.074891 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:06.074848    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:06.075327 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:06.074985    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:06.075327 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:06.075105    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:07.074412 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:07.074354    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:07.074602 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:07.074485    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:08.073920 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:08.073888    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:08.074280 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:08.074002    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:08.074280 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:08.074056    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:08.074280 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:08.074157    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:09.074313 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:09.074281    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:09.074768 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:09.074399    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:10.074083 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:10.074004    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:10.074246 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.074159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:10.074246 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:10.074220    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:10.074373 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.074347    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:10.774212 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:10.774180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:10.774422 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:10.774232    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:10.774422 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.774359    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:10.774526 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.774441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:26.77442116 +0000 UTC m=+33.132410380 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:10.774526 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.774363    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:10.774617 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.774530    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:26.774500677 +0000 UTC m=+33.132489918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:10.875050 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:10.875009    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:10.875240 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.875217    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:17:10.875287 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.875247    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:17:10.875287 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.875262    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:10.875372 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:10.875333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:26.875314067 +0000 UTC m=+33.233303302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:11.074531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:11.074463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:11.074895 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:11.074565    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:12.074655 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:12.074617    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:12.075111 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:12.074784    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:12.075111 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:12.074843    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:12.075111 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:12.074965    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:13.074367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:13.074338    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:13.074558 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:13.074451    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:14.075278 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:14.075243    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:14.075732 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:14.075345    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:14.075732 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:14.075407    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:14.075732 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:14.075515    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:15.074047 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:15.074024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:15.074199 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:15.074123    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:16.074341 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:16.073824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:16.074341 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:16.073969    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:16.074341 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:16.074028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:16.074341 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:16.074155    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:17.074598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.074430    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:17.075057 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:17.074695    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:17.218996 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.218968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal" event={"ID":"1bded2ed6bb26343f6cb8a89495340f4","Type":"ContainerStarted","Data":"b2e89c4614dc6ee84182267656fdb4ede45e2d46edb02f1c50f7e915b42be6a2"}
Jul 21 00:17:17.221887 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.221859    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2thjl" event={"ID":"a6da106b-9733-45b1-81f1-e67784d43c1e","Type":"ContainerStarted","Data":"ae10b7be9e84b2e24dae7ae95f0fac6547a5f8082ecab84df0c128c7225efb37"}
Jul 21 00:17:17.223412 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.223390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cdtfx" event={"ID":"f24a7e14-6fc2-45ab-b6de-4f5ba383d179","Type":"ContainerStarted","Data":"e83e0419e300d4a1493cb8c32ca06bb991f2ef0726c4124ce357b8975356834d"}
Jul 21 00:17:17.227186 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227169    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:17:17.227473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227456    2576 generic.go:356] "Generic (PLEG): container finished" podID="79e22b50-c889-4f00-bace-83910f1a4bca" containerID="27c6c40fa0b6395130fa1fb72eb12b330600420ded5605f9b6263ac5a2488699" exitCode=1
Jul 21 00:17:17.227553 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227484    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"3c8f7bd5944cb5288c5d2fb8cd4f115c7093e88ece73edc77de770679e1d8070"}
Jul 21 00:17:17.227553 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"5e995169fced74e68431337f151b9912bfcf586975fb569004849f5c999e533f"}
Jul 21 00:17:17.227650 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227568    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"d4de9d313360d182368b60a757a6b22ba5b02b817f52a4a23bf8d9773c7f311b"}
Jul 21 00:17:17.227650 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"2ca3afbe09b5f68ca475771a31ee52873ba97a6f99606d831448676f75e4644d"}
Jul 21 00:17:17.227650 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227630    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerDied","Data":"27c6c40fa0b6395130fa1fb72eb12b330600420ded5605f9b6263ac5a2488699"}
Jul 21 00:17:17.227802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.227693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"da95c9d5b8dd05e900c84792c0ca1c4060397472f97dcd912213bff58ea8f457"}
Jul 21 00:17:17.232266 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.232229    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-120.ec2.internal" podStartSLOduration=22.232218547 podStartE2EDuration="22.232218547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:17.231823961 +0000 UTC m=+23.589813201" watchObservedRunningTime="2026-07-21 00:17:17.232218547 +0000 UTC m=+23.590207786"
Jul 21 00:17:17.247585 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.247552    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2thjl" podStartSLOduration=2.148686413 podStartE2EDuration="23.247541502s" totalImagesPullingTime="21.098855089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:17.247114907 +0000 UTC m=+23.605104149" watchObservedRunningTime="2026-07-21 00:17:17.247541502 +0000 UTC m=+23.605530742"
Jul 21 00:17:17.263508 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:17.263470    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cdtfx" podStartSLOduration=1.186478222 podStartE2EDuration="22.263458917s" totalImagesPullingTime="21.076980695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:17.263413908 +0000 UTC m=+23.621403148" watchObservedRunningTime="2026-07-21 00:17:17.263458917 +0000 UTC m=+23.621448157"
Jul 21 00:17:18.073958 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.073886    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:18.074087 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:18.074006    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:18.074087 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.074066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:18.074204 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:18.074187    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:18.231036 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.231000    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ldgww" event={"ID":"4d6adef2-337e-422e-9537-d0838d2c92c1","Type":"ContainerStarted","Data":"b824d469afd97862733a6fccf1c45e948e79a8a0eef27d9da652579b4ec85acf"}
Jul 21 00:17:18.232372 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.232347    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8wsn" event={"ID":"bb5a13f9-59ec-4300-9180-adeebf1a09e1","Type":"ContainerStarted","Data":"8418a15bd664a5994791f50319fab788b913974aa80f88aef5662abd1d19d94a"}
Jul 21 00:17:18.233572 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.233549    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlnh6" event={"ID":"323fc16c-0d59-4d38-85da-04e3672d279b","Type":"ContainerStarted","Data":"2f8a40d511c83dcb461a19bb2d1fe3a594fffe0a5869e0311d9dbbe72c10e804"}
Jul 21 00:17:18.234977 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.234953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z" event={"ID":"07bed11e-0c3c-4aae-981f-8d442585de95","Type":"ContainerStarted","Data":"ac2653dd5d27f4547f8d9dd1b2e08e813f0a8bee7aab8093d6ca3a873101577a"}
Jul 21 00:17:18.236235 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.236212    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q8gxv" event={"ID":"791bc4bf-d3ba-4eb2-ba86-5d16ccfb2d90","Type":"ContainerStarted","Data":"ffd2c3f7a7028f7d25282931204badf04ba74d89ae573e4db347f8fe71a7f3fb"}
Jul 21 00:17:18.237613 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.237595    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="0eb62c2b4016adb94684c0c2920c231634291d8720eb7b0e737e4518f3c283d3" exitCode=0
Jul 21 00:17:18.237709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.237652    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"0eb62c2b4016adb94684c0c2920c231634291d8720eb7b0e737e4518f3c283d3"}
Jul 21 00:17:18.239210 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.239191    2576 generic.go:356] "Generic (PLEG): container finished" podID="f216092c62580edcf5f9f192677fb05d" containerID="00e003cd9d28d59c9cc3c419f9ef3752fdd0053d3aa01527c6497a11216e211b" exitCode=0
Jul 21 00:17:18.239299 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.239275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal" event={"ID":"f216092c62580edcf5f9f192677fb05d","Type":"ContainerDied","Data":"00e003cd9d28d59c9cc3c419f9ef3752fdd0053d3aa01527c6497a11216e211b"}
Jul 21 00:17:18.245419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.245379    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ldgww" podStartSLOduration=3.161767929 podStartE2EDuration="24.245368912s" totalImagesPullingTime="21.083600983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:18.244856459 +0000 UTC m=+24.602845698" watchObservedRunningTime="2026-07-21 00:17:18.245368912 +0000 UTC m=+24.603358151"
Jul 21 00:17:18.258131 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.258095    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q8gxv" podStartSLOduration=3.17967267 podStartE2EDuration="24.258083803s" totalImagesPullingTime="21.078411133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:18.257913585 +0000 UTC m=+24.615902824" watchObservedRunningTime="2026-07-21 00:17:18.258083803 +0000 UTC m=+24.616073375"
Jul 21 00:17:18.290840 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.290791    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nlnh6" podStartSLOduration=2.281490652 podStartE2EDuration="23.290776076s" totalImagesPullingTime="21.009285424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:18.289734857 +0000 UTC m=+24.647724096" watchObservedRunningTime="2026-07-21 00:17:18.290776076 +0000 UTC m=+24.648765319"
Jul 21 00:17:18.332113 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.331914    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n8wsn" podStartSLOduration=3.237434378 podStartE2EDuration="24.331902216s" totalImagesPullingTime="21.094467838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:18.331527456 +0000 UTC m=+24.689516697" watchObservedRunningTime="2026-07-21 00:17:18.331902216 +0000 UTC m=+24.689891456"
Jul 21 00:17:18.806590 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:18.806569    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 00:17:19.002036 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.001923    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T00:17:18.80658711Z","UUID":"aad3bad5-8471-45f8-9660-490a8e22d0ae","Handler":null,"Name":"","Endpoint":""}
Jul 21 00:17:19.003499 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.003476    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 00:17:19.003616 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.003517    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 00:17:19.074232 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.074207    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:19.074380 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:19.074345    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:19.243215 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.243134    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z" event={"ID":"07bed11e-0c3c-4aae-981f-8d442585de95","Type":"ContainerStarted","Data":"93a95e5915bd258e3e1e6f213728d4c339aa9e9c392f659fd4bf304d902fd31f"}
Jul 21 00:17:19.245039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.245017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal" event={"ID":"f216092c62580edcf5f9f192677fb05d","Type":"ContainerStarted","Data":"732552e7e1981d3d09d8c19b678f806debfcbaec29f84131d203ebe171cceefe"}
Jul 21 00:17:19.262006 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:19.261941    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-120.ec2.internal" podStartSLOduration=24.2619281 podStartE2EDuration="24.2619281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:19.261561349 +0000 UTC m=+25.619550589" watchObservedRunningTime="2026-07-21 00:17:19.2619281 +0000 UTC m=+25.619917340"
Jul 21 00:17:20.074237 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:20.074208    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:20.074497 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:20.074349    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:20.074863 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:20.074833    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:20.074990 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:20.074943    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:20.251435 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:20.251406    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:17:20.251960 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:20.251904    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"2357f1624510b71d2da11f9f875c4c928eee12aba7de14bb0f4fad7e458d1a0a"}
Jul 21 00:17:21.073975 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:21.073947    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:21.074143 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:21.074051    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:21.257323 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:21.257289    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z" event={"ID":"07bed11e-0c3c-4aae-981f-8d442585de95","Type":"ContainerStarted","Data":"2dea21c99c9f81946d097d6bb7f6dbb395983d33d2c4413a2644d88d2beb090b"}
Jul 21 00:17:21.275883 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:21.275810    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n6z9z" podStartSLOduration=2.223155062 podStartE2EDuration="26.275796477s" totalImagesPullingTime="24.052641415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:21.275161008 +0000 UTC m=+27.633150249" watchObservedRunningTime="2026-07-21 00:17:21.275796477 +0000 UTC m=+27.633785735"
Jul 21 00:17:22.024934 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.024744    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:17:22.025392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.025373    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:17:22.073799 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.073771    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:22.073799 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.073778    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:22.073966 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:22.073922    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:22.074110 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:22.074078    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:22.263182 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.263157    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:17:22.263803 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.263527    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"e6a35fadea84adf2a01ef9fdc868a5daf80e1218e6fd2b366230c9c098853804"}
Jul 21 00:17:22.263803 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.263751    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:17:22.264115 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.264095    2576 scope.go:117] "RemoveContainer" containerID="27c6c40fa0b6395130fa1fb72eb12b330600420ded5605f9b6263ac5a2488699"
Jul 21 00:17:22.264257 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:22.264241    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nlnh6"
Jul 21 00:17:23.074598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.074567    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:23.074873 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:23.074708    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:23.270523 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.270399    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:17:23.271270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.271241    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" event={"ID":"79e22b50-c889-4f00-bace-83910f1a4bca","Type":"ContainerStarted","Data":"dfbbafb23095d3d65ea813937a9264be6113fec78a335a5f43e8c26264977613"}
Jul 21 00:17:23.271863 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.271840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:23.271971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.271919    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:23.271971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.271966    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:23.289113 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.289062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:23.289936 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.289911    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:23.307387 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.307351    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9" podStartSLOduration=8.105672382 podStartE2EDuration="29.307338522s" totalImagesPullingTime="21.20166614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:23.30632589 +0000 UTC m=+29.664315130" watchObservedRunningTime="2026-07-21 00:17:23.307338522 +0000 UTC m=+29.665327763"
Jul 21 00:17:23.434620 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.434562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h8lxz"]
Jul 21 00:17:23.434769 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.434757    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:23.434896 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:23.434875    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:23.438155 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.437640    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ldmkz"]
Jul 21 00:17:23.438260 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.438219    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:23.438333 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:23.438313    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:23.438387 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.438367    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8vwz"]
Jul 21 00:17:23.438478 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:23.438453    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:23.438546 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:23.438531    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:24.274110 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:24.274079    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="13080d999b2e18f908b3c6722a5219a35576378b272d7ef275a4a2446977f689" exitCode=0
Jul 21 00:17:24.274605 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:24.274160    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"13080d999b2e18f908b3c6722a5219a35576378b272d7ef275a4a2446977f689"}
Jul 21 00:17:25.074434 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:25.074401    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:25.074612 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:25.074509    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:25.074612 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:25.074514    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:25.074612 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:25.074556    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:25.074784 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:25.074644    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:25.074784 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:25.074763    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:26.281078 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:26.281043    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="05cc4c07c57f9f1e9ecc4c0df9e54a08932c717d36227faf58cd86617d8ad6e7" exitCode=0
Jul 21 00:17:26.281415 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:26.281106    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"05cc4c07c57f9f1e9ecc4c0df9e54a08932c717d36227faf58cd86617d8ad6e7"}
Jul 21 00:17:26.796778 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:26.796744    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:26.796954 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:26.796796    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:26.796954 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.796884    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:26.796954 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.796910    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:26.796954 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.796934    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret podName:49f64862-b311-47a6-b22e-6de917d42ec8 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:58.796920992 +0000 UTC m=+65.154910210 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret") pod "global-pull-secret-syncer-w8vwz" (UID: "49f64862-b311-47a6-b22e-6de917d42ec8") : object "kube-system"/"original-pull-secret" not registered
Jul 21 00:17:26.797108 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.796968    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:58.796951622 +0000 UTC m=+65.154940849 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 00:17:26.897318 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:26.897285    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:26.897484 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.897460    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 00:17:26.897484 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.897483    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 00:17:26.897597 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.897498    2576 projected.go:196] Error preparing data for projected volume kube-api-access-4bx47 for pod openshift-network-diagnostics/network-check-target-ldmkz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:26.897597 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:26.897563    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47 podName:a6a56242-4d6d-4197-84c0-c9d79c983d89 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:58.897543728 +0000 UTC m=+65.255532961 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4bx47" (UniqueName: "kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47") pod "network-check-target-ldmkz" (UID: "a6a56242-4d6d-4197-84c0-c9d79c983d89") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 00:17:27.074637 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:27.074574    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:27.074637 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:27.074602    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:27.074819 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:27.074703    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:27.074819 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:27.074752    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:27.074893 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:27.074863    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:27.074967 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:27.074949    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:28.288108 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:28.287933    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="7aca9c250a4a793d7766d8bc5745385162cef97cd7ebbbaefa82df2d10c4b1b0" exitCode=0
Jul 21 00:17:28.288108 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:28.288024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"7aca9c250a4a793d7766d8bc5745385162cef97cd7ebbbaefa82df2d10c4b1b0"}
Jul 21 00:17:29.074195 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.074161    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:29.074382 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.074209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:29.074382 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.074273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:29.074382 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:29.074292    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-w8vwz" podUID="49f64862-b311-47a6-b22e-6de917d42ec8"
Jul 21 00:17:29.074382 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:29.074368    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:17:29.074592 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:29.074457    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-ldmkz" podUID="a6a56242-4d6d-4197-84c0-c9d79c983d89"
Jul 21 00:17:29.499021 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.498987    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-120.ec2.internal" event="NodeReady"
Jul 21 00:17:29.499426 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.499148    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 00:17:29.539499 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.539468    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bbcdd"]
Jul 21 00:17:29.563481 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.563443    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4dp6c"]
Jul 21 00:17:29.564107 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.563750    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.566153 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.566128    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 00:17:29.566328 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.566187    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26lqt\""
Jul 21 00:17:29.566328 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.566254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 00:17:29.579295 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.579270    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbcdd"]
Jul 21 00:17:29.579403 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.579312    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dp6c"]
Jul 21 00:17:29.579459 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.579412    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.582909 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.582812    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 00:17:29.583002 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.582933    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 00:17:29.583835 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.583204    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 00:17:29.584512 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.584492    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-znvqg\""
Jul 21 00:17:29.717705 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717657    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqh7c\" (UniqueName: \"kubernetes.io/projected/d14d798c-9089-47a2-b04c-3d662970d855-kube-api-access-sqh7c\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.717878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14d798c-9089-47a2-b04c-3d662970d855-tmp-dir\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.717878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.717878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6167a704-133a-49a1-ba52-4d7d379ca4bf-cert\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.717878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717843    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d14d798c-9089-47a2-b04c-3d662970d855-config-volume\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.718030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.717879    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctqjg\" (UniqueName: \"kubernetes.io/projected/6167a704-133a-49a1-ba52-4d7d379ca4bf-kube-api-access-ctqjg\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.819139 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.819139 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6167a704-133a-49a1-ba52-4d7d379ca4bf-cert\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.819139 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819114    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d14d798c-9089-47a2-b04c-3d662970d855-config-volume\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.819406 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctqjg\" (UniqueName: \"kubernetes.io/projected/6167a704-133a-49a1-ba52-4d7d379ca4bf-kube-api-access-ctqjg\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.819406 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819177    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqh7c\" (UniqueName: \"kubernetes.io/projected/d14d798c-9089-47a2-b04c-3d662970d855-kube-api-access-sqh7c\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.819406 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819209    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14d798c-9089-47a2-b04c-3d662970d855-tmp-dir\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.819406 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:29.819231    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:29.819406 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:29.819333    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:30.319310048 +0000 UTC m=+36.677299281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:29.819596 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819552    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d14d798c-9089-47a2-b04c-3d662970d855-tmp-dir\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.819710 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.819690    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d14d798c-9089-47a2-b04c-3d662970d855-config-volume\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.823448 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.823419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6167a704-133a-49a1-ba52-4d7d379ca4bf-cert\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.827265 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.827240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqh7c\" (UniqueName: \"kubernetes.io/projected/d14d798c-9089-47a2-b04c-3d662970d855-kube-api-access-sqh7c\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:29.827587 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.827569    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctqjg\" (UniqueName: \"kubernetes.io/projected/6167a704-133a-49a1-ba52-4d7d379ca4bf-kube-api-access-ctqjg\") pod \"ingress-canary-4dp6c\" (UID: \"6167a704-133a-49a1-ba52-4d7d379ca4bf\") " pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:29.898862 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:29.898825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4dp6c"
Jul 21 00:17:30.102842 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:30.102775    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4dp6c"]
Jul 21 00:17:30.108936 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:17:30.108908    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6167a704_133a_49a1_ba52_4d7d379ca4bf.slice/crio-fff91f88a1296bfdb200058b71dda1880c51dd9886f37e491854fa9880e7500c WatchSource:0}: Error finding container fff91f88a1296bfdb200058b71dda1880c51dd9886f37e491854fa9880e7500c: Status 404 returned error can't find the container with id fff91f88a1296bfdb200058b71dda1880c51dd9886f37e491854fa9880e7500c
Jul 21 00:17:30.294625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:30.294579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dp6c" event={"ID":"6167a704-133a-49a1-ba52-4d7d379ca4bf","Type":"ContainerStarted","Data":"fff91f88a1296bfdb200058b71dda1880c51dd9886f37e491854fa9880e7500c"}
Jul 21 00:17:30.323017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:30.322979    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:30.323201 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:30.323092    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:30.323201 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:30.323167    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:31.323148565 +0000 UTC m=+37.681137782 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:31.073687 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.073636    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:31.074422 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.073703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:31.074422 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.073703    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:31.077653 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.077633    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:17:31.077790 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.077733    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m4mrq\""
Jul 21 00:17:31.077790 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.077753    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:17:31.077790 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.077760    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:17:31.078343 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.078326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:17:31.078445 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.078430    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztz7f\""
Jul 21 00:17:31.330788 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:31.330498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:31.330955 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:31.330693    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:31.330955 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:31.330892    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:33.330874757 +0000 UTC m=+39.688863979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:33.305453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:33.305413    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="8414a307405767d46c8729a76b68d6eec448df13adea1149e592ca13407147b5" exitCode=0
Jul 21 00:17:33.305914 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:33.305491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"8414a307405767d46c8729a76b68d6eec448df13adea1149e592ca13407147b5"}
Jul 21 00:17:33.347349 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:33.347320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:33.347565 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:33.347548    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:33.347629 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:33.347616    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:37.347595939 +0000 UTC m=+43.705585160 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:34.311625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:34.311587    2576 generic.go:356] "Generic (PLEG): container finished" podID="7ace5bb2-c537-4536-85b6-0b614b9c39ca" containerID="1d34f889031053ad955ffb6aea6ed1eafdd67f489c2e605ef582e9670803d445" exitCode=0
Jul 21 00:17:34.312106 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:34.311683    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerDied","Data":"1d34f889031053ad955ffb6aea6ed1eafdd67f489c2e605ef582e9670803d445"}
Jul 21 00:17:35.317270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:35.317240    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" event={"ID":"7ace5bb2-c537-4536-85b6-0b614b9c39ca","Type":"ContainerStarted","Data":"2eaeb41674aa8abf4ef170010bbf424c26b00c05c0267113194aadeef2a3a6e0"}
Jul 21 00:17:35.351396 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:35.351353    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9h5cf" podStartSLOduration=8.508987388 podStartE2EDuration="41.351337577s" totalImagesPullingTime="32.842350189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:35.349228324 +0000 UTC m=+41.707217567" watchObservedRunningTime="2026-07-21 00:17:35.351337577 +0000 UTC m=+41.709326816"
Jul 21 00:17:36.323724 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:36.323680    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4dp6c" event={"ID":"6167a704-133a-49a1-ba52-4d7d379ca4bf","Type":"ContainerStarted","Data":"a8ded24a5bffdec6c3904a5995de9f47a9f17e2820e36c81e9c67dc0a361c94b"}
Jul 21 00:17:37.381254 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:37.381219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:37.381601 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:37.381315    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:37.381601 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:37.381366    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:17:45.38135255 +0000 UTC m=+51.739341769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:45.434270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:45.434230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:17:45.434720 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:45.434357    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:17:45.434720 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:45.434407    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:18:01.434394415 +0000 UTC m=+67.792383646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:17:55.287030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:55.287002    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c74q9"
Jul 21 00:17:55.318937 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:55.318889    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4dp6c" podStartSLOduration=21.143903934 podStartE2EDuration="26.318876595s" totalImagesPullingTime="5.174972661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:17:36.347089031 +0000 UTC m=+42.705078270" watchObservedRunningTime="2026-07-21 00:17:55.318876595 +0000 UTC m=+61.676865838"
Jul 21 00:17:58.820098 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.820057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:58.820545 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.820121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:17:58.822321 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.822302    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 00:17:58.822395 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.822302    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 00:17:58.830986 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:58.830962    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 00:17:58.831038 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:17:58.831020    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:19:02.831004974 +0000 UTC m=+129.188994192 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : secret "metrics-daemon-secret" not found
Jul 21 00:17:58.834276 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.834259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/49f64862-b311-47a6-b22e-6de917d42ec8-original-pull-secret\") pod \"global-pull-secret-syncer-w8vwz\" (UID: \"49f64862-b311-47a6-b22e-6de917d42ec8\") " pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:58.920943 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.920910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:58.923522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.923506    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 00:17:58.933505 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.933490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 00:17:58.944657 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.944632    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bx47\" (UniqueName: \"kubernetes.io/projected/a6a56242-4d6d-4197-84c0-c9d79c983d89-kube-api-access-4bx47\") pod \"network-check-target-ldmkz\" (UID: \"a6a56242-4d6d-4197-84c0-c9d79c983d89\") " pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:58.983997 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.983964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-w8vwz"
Jul 21 00:17:58.997134 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:58.997115    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m4mrq\""
Jul 21 00:17:59.005942 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:59.005922    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:17:59.108700 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:59.108621    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-w8vwz"]
Jul 21 00:17:59.113248 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:17:59.113222    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f64862_b311_47a6_b22e_6de917d42ec8.slice/crio-ec3872b2f29db7ab8d8c4e590e30c058cf4b5c55c591f5088453f26545d3e1b7 WatchSource:0}: Error finding container ec3872b2f29db7ab8d8c4e590e30c058cf4b5c55c591f5088453f26545d3e1b7: Status 404 returned error can't find the container with id ec3872b2f29db7ab8d8c4e590e30c058cf4b5c55c591f5088453f26545d3e1b7
Jul 21 00:17:59.127961 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:59.127898    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-ldmkz"]
Jul 21 00:17:59.131049 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:17:59.131016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a56242_4d6d_4197_84c0_c9d79c983d89.slice/crio-d268b952bc5840e5379a9d29af47e0be583677a7cdeb77b540b3663f0c125b6e WatchSource:0}: Error finding container d268b952bc5840e5379a9d29af47e0be583677a7cdeb77b540b3663f0c125b6e: Status 404 returned error can't find the container with id d268b952bc5840e5379a9d29af47e0be583677a7cdeb77b540b3663f0c125b6e
Jul 21 00:17:59.380355 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:59.380268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ldmkz" event={"ID":"a6a56242-4d6d-4197-84c0-c9d79c983d89","Type":"ContainerStarted","Data":"d268b952bc5840e5379a9d29af47e0be583677a7cdeb77b540b3663f0c125b6e"}
Jul 21 00:17:59.381322 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:17:59.381298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8vwz" event={"ID":"49f64862-b311-47a6-b22e-6de917d42ec8","Type":"ContainerStarted","Data":"ec3872b2f29db7ab8d8c4e590e30c058cf4b5c55c591f5088453f26545d3e1b7"}
Jul 21 00:18:01.440860 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:01.440821    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:18:01.441333 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:18:01.440980    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:18:01.441333 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:18:01.441056    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:18:33.441036331 +0000 UTC m=+99.799025569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:18:04.396566 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:04.396519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-ldmkz" event={"ID":"a6a56242-4d6d-4197-84c0-c9d79c983d89","Type":"ContainerStarted","Data":"6921ebbab487fff39848280c2a21cfd723148e8de853b8b52f5bbfe6ec077892"}
Jul 21 00:18:04.397113 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:04.396617    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:18:04.398021 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:04.397998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-w8vwz" event={"ID":"49f64862-b311-47a6-b22e-6de917d42ec8","Type":"ContainerStarted","Data":"8e52b32df142acabe2c84c8e3dbcc4f2a925b09b2fc0e1678c6155b1375b0c06"}
Jul 21 00:18:04.410706 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:04.410646    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-ldmkz" podStartSLOduration=64.901934305 podStartE2EDuration="1m9.410632035s" totalImagesPullingTime="4.50869773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:18:04.410407106 +0000 UTC m=+70.768396347" watchObservedRunningTime="2026-07-21 00:18:04.410632035 +0000 UTC m=+70.768621294"
Jul 21 00:18:04.426867 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:04.426822    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-w8vwz" podStartSLOduration=64.895149545 podStartE2EDuration="1m9.426808483s" totalImagesPullingTime="4.531658938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:16:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:18:04.426400136 +0000 UTC m=+70.784389376" watchObservedRunningTime="2026-07-21 00:18:04.426808483 +0000 UTC m=+70.784797723"
Jul 21 00:18:22.556172 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.556141    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"]
Jul 21 00:18:22.558541 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.558524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.563172 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.563147    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 00:18:22.563285 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.563238    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 00:18:22.564146 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.564113    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 00:18:22.564259 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.564162    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 00:18:22.565625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.565592    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"]
Jul 21 00:18:22.568463 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.568440    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.570995 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.570975    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 00:18:22.571794 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.571775    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-scpb7\""
Jul 21 00:18:22.578429 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.578397    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"]
Jul 21 00:18:22.581180 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.581157    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"]
Jul 21 00:18:22.681351 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.681325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt785\" (UniqueName: \"kubernetes.io/projected/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-kube-api-access-mt785\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.681480 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.681374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-tmp\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.681480 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.681389    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-klusterlet-config\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.681480 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.681404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a877aefa-dc43-48e5-9264-14efe485b3ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.681480 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.681460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9gs\" (UniqueName: \"kubernetes.io/projected/a877aefa-dc43-48e5-9264-14efe485b3ce-kube-api-access-5m9gs\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.781769 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.781720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-tmp\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.781929 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.781777    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-klusterlet-config\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.781929 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.781795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a877aefa-dc43-48e5-9264-14efe485b3ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.781929 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.781814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9gs\" (UniqueName: \"kubernetes.io/projected/a877aefa-dc43-48e5-9264-14efe485b3ce-kube-api-access-5m9gs\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.781929 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.781860    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt785\" (UniqueName: \"kubernetes.io/projected/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-kube-api-access-mt785\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.782196 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.782175    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-tmp\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.784271 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.784254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a877aefa-dc43-48e5-9264-14efe485b3ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.784328 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.784273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-klusterlet-config\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.791211 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.791185    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9gs\" (UniqueName: \"kubernetes.io/projected/a877aefa-dc43-48e5-9264-14efe485b3ce-kube-api-access-5m9gs\") pod \"managed-serviceaccount-addon-agent-98cb79bb6-zbdjf\" (UID: \"a877aefa-dc43-48e5-9264-14efe485b3ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.791589 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.791570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt785\" (UniqueName: \"kubernetes.io/projected/9ef8bf24-dfe1-4fde-aff7-ef979fc2448e-kube-api-access-mt785\") pod \"klusterlet-addon-workmgr-79ccfff97d-bcn69\" (UID: \"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.868600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.868549    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:22.886842 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.886748    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"
Jul 21 00:18:22.995938 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:22.995911    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"]
Jul 21 00:18:23.000140 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:18:23.000112    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef8bf24_dfe1_4fde_aff7_ef979fc2448e.slice/crio-d6f63010e142713c6ef81309eda3ca3319152ed6654544f89c5d35ce88e9ca53 WatchSource:0}: Error finding container d6f63010e142713c6ef81309eda3ca3319152ed6654544f89c5d35ce88e9ca53: Status 404 returned error can't find the container with id d6f63010e142713c6ef81309eda3ca3319152ed6654544f89c5d35ce88e9ca53
Jul 21 00:18:23.019326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:23.019302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf"]
Jul 21 00:18:23.022594 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:18:23.022573    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda877aefa_dc43_48e5_9264_14efe485b3ce.slice/crio-88b2f4f78037f2dad52a2d7469ae9b9c1fd638dd7ebb94c9e27504146612ad89 WatchSource:0}: Error finding container 88b2f4f78037f2dad52a2d7469ae9b9c1fd638dd7ebb94c9e27504146612ad89: Status 404 returned error can't find the container with id 88b2f4f78037f2dad52a2d7469ae9b9c1fd638dd7ebb94c9e27504146612ad89
Jul 21 00:18:23.445469 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:23.445432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" event={"ID":"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e","Type":"ContainerStarted","Data":"d6f63010e142713c6ef81309eda3ca3319152ed6654544f89c5d35ce88e9ca53"}
Jul 21 00:18:23.446807 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:23.446775    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf" event={"ID":"a877aefa-dc43-48e5-9264-14efe485b3ce","Type":"ContainerStarted","Data":"88b2f4f78037f2dad52a2d7469ae9b9c1fd638dd7ebb94c9e27504146612ad89"}
Jul 21 00:18:27.459178 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.459145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf" event={"ID":"a877aefa-dc43-48e5-9264-14efe485b3ce","Type":"ContainerStarted","Data":"75b920173a28a10f5252364042acaab951e5616ed37975f0346bac412faadfc3"}
Jul 21 00:18:27.460382 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.460358    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" event={"ID":"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e","Type":"ContainerStarted","Data":"a41ac6345e94d03c5a43b2f67ab43e98426fb8a83704d52fed88f552527ea4f7"}
Jul 21 00:18:27.460916 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.460902    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:27.462523 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.462505    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:18:27.479111 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.479071    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf" podStartSLOduration=1.792729244 podStartE2EDuration="5.479059064s" totalImagesPullingTime="3.68632982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:18:27.478147774 +0000 UTC m=+93.836137017" watchObservedRunningTime="2026-07-21 00:18:27.479059064 +0000 UTC m=+93.837048303"
Jul 21 00:18:27.497993 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:27.497954    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" podStartSLOduration=1.778381182 podStartE2EDuration="5.497941013s" totalImagesPullingTime="3.719559831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:18:27.497133175 +0000 UTC m=+93.855122415" watchObservedRunningTime="2026-07-21 00:18:27.497941013 +0000 UTC m=+93.855930253"
Jul 21 00:18:33.456875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:33.456837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:18:33.457282 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:18:33.456983    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:18:33.457282 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:18:33.457045    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:19:37.457030432 +0000 UTC m=+163.815019650 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:18:35.402971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:18:35.402941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-ldmkz"
Jul 21 00:19:02.860144 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:19:02.860089    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:19:02.860562 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:02.860242    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 00:19:02.860562 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:02.860321    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:04.860301495 +0000 UTC m=+251.218290921 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : secret "metrics-daemon-secret" not found
Jul 21 00:19:32.574134 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:32.574088    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbcdd" podUID="d14d798c-9089-47a2-b04c-3d662970d855"
Jul 21 00:19:32.646452 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:19:32.646422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:19:34.089821 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:34.089787    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:19:37.489431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:19:37.489382    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:19:37.489858 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:37.489526    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 00:19:37.489858 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:19:37.489584    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls podName:d14d798c-9089-47a2-b04c-3d662970d855 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:39.489567537 +0000 UTC m=+285.847556755 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls") pod "dns-default-bbcdd" (UID: "d14d798c-9089-47a2-b04c-3d662970d855") : secret "dns-default-metrics-tls" not found
Jul 21 00:19:49.073729 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:19:49.073644    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:20:27.461643 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.461598    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" podUID="9ef8bf24-dfe1-4fde-aff7-ef979fc2448e" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jul 21 00:20:27.796890 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.796805    2576 generic.go:356] "Generic (PLEG): container finished" podID="a877aefa-dc43-48e5-9264-14efe485b3ce" containerID="75b920173a28a10f5252364042acaab951e5616ed37975f0346bac412faadfc3" exitCode=255
Jul 21 00:20:27.796890 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.796875    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf" event={"ID":"a877aefa-dc43-48e5-9264-14efe485b3ce","Type":"ContainerDied","Data":"75b920173a28a10f5252364042acaab951e5616ed37975f0346bac412faadfc3"}
Jul 21 00:20:27.798120 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.798094    2576 generic.go:356] "Generic (PLEG): container finished" podID="9ef8bf24-dfe1-4fde-aff7-ef979fc2448e" containerID="a41ac6345e94d03c5a43b2f67ab43e98426fb8a83704d52fed88f552527ea4f7" exitCode=1
Jul 21 00:20:27.798232 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.798129    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" event={"ID":"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e","Type":"ContainerDied","Data":"a41ac6345e94d03c5a43b2f67ab43e98426fb8a83704d52fed88f552527ea4f7"}
Jul 21 00:20:27.798503 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.798486    2576 scope.go:117] "RemoveContainer" containerID="a41ac6345e94d03c5a43b2f67ab43e98426fb8a83704d52fed88f552527ea4f7"
Jul 21 00:20:27.803266 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:27.803251    2576 scope.go:117] "RemoveContainer" containerID="75b920173a28a10f5252364042acaab951e5616ed37975f0346bac412faadfc3"
Jul 21 00:20:28.802208 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:28.802172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98cb79bb6-zbdjf" event={"ID":"a877aefa-dc43-48e5-9264-14efe485b3ce","Type":"ContainerStarted","Data":"51963cdbd60b849eb7848185da56940157e24b7d843f9347c6ce421b7de2647c"}
Jul 21 00:20:28.803781 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:28.803748    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69" event={"ID":"9ef8bf24-dfe1-4fde-aff7-ef979fc2448e","Type":"ContainerStarted","Data":"7af40b85740c50183aebf3006a4f8ce75419a200e286daa9b4325ae6238ec097"}
Jul 21 00:20:28.804029 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:28.804009    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:20:28.804527 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:28.804510    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-79ccfff97d-bcn69"
Jul 21 00:20:54.618438 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.618403    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6664cb745d-xdmhp"]
Jul 21 00:20:54.621257 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.621240    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.624713 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.624690    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 21 00:20:54.624824 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.624798    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 21 00:20:54.624824 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.624817    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 21 00:20:54.624925 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.624807    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 00:20:54.625149 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.625135    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 21 00:20:54.625210 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.625139    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 00:20:54.625300 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.625286    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9pql7\""
Jul 21 00:20:54.647834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.647814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6664cb745d-xdmhp"]
Jul 21 00:20:54.705843 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.705804    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dl2lf\" (UniqueName: \"kubernetes.io/projected/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-kube-api-access-dl2lf\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.706020 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.705863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.706020 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.705943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.706020 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.705993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-stats-auth\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.706020 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.706013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-default-certificate\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.708571 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.708545    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"]
Jul 21 00:20:54.711305 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.711284    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"
Jul 21 00:20:54.713816 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.713798    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-zp2n5\""
Jul 21 00:20:54.723295 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.723277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"]
Jul 21 00:20:54.807290 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807255    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-stats-auth\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.807290 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-default-certificate\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.807527 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807308    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dl2lf\" (UniqueName: \"kubernetes.io/projected/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-kube-api-access-dl2lf\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.807527 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.807527 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v6kn\" (UniqueName: \"kubernetes.io/projected/dd682a62-3447-4fa7-a79e-a6b1d8693d16-kube-api-access-5v6kn\") pod \"network-check-source-7bc5b6bf85-zx22r\" (UID: \"dd682a62-3447-4fa7-a79e-a6b1d8693d16\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"
Jul 21 00:20:54.807527 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.807403    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.807527 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:54.807501    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 00:20:54.807801 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:54.807549    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:55.30753083 +0000 UTC m=+241.665520098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:20:54.807801 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:54.807570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:55.307562092 +0000 UTC m=+241.665551309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : secret "router-metrics-certs-default" not found
Jul 21 00:20:54.809824 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.809801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-stats-auth\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.809908 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.809836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-default-certificate\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.815802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.815772    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dl2lf\" (UniqueName: \"kubernetes.io/projected/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-kube-api-access-dl2lf\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:54.908391 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.908298    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v6kn\" (UniqueName: \"kubernetes.io/projected/dd682a62-3447-4fa7-a79e-a6b1d8693d16-kube-api-access-5v6kn\") pod \"network-check-source-7bc5b6bf85-zx22r\" (UID: \"dd682a62-3447-4fa7-a79e-a6b1d8693d16\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"
Jul 21 00:20:54.916545 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:54.916512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v6kn\" (UniqueName: \"kubernetes.io/projected/dd682a62-3447-4fa7-a79e-a6b1d8693d16-kube-api-access-5v6kn\") pod \"network-check-source-7bc5b6bf85-zx22r\" (UID: \"dd682a62-3447-4fa7-a79e-a6b1d8693d16\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"
Jul 21 00:20:55.019571 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.019532    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"
Jul 21 00:20:55.140789 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.140758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r"]
Jul 21 00:20:55.143783 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:20:55.143755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd682a62_3447_4fa7_a79e_a6b1d8693d16.slice/crio-3e679e8b226ddc44f3864a34d47c8d546f6887b9188c1da524d84fb58e572212 WatchSource:0}: Error finding container 3e679e8b226ddc44f3864a34d47c8d546f6887b9188c1da524d84fb58e572212: Status 404 returned error can't find the container with id 3e679e8b226ddc44f3864a34d47c8d546f6887b9188c1da524d84fb58e572212
Jul 21 00:20:55.312632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.312602    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:55.312823 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.312656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:55.312823 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:55.312794    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:56.312774841 +0000 UTC m=+242.670764076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:20:55.312823 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:55.312807    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 00:20:55.312944 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:55.312843    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:56.312833827 +0000 UTC m=+242.670823044 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : secret "router-metrics-certs-default" not found
Jul 21 00:20:55.881080 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.881036    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r" event={"ID":"dd682a62-3447-4fa7-a79e-a6b1d8693d16","Type":"ContainerStarted","Data":"e49761afd8d6eda14f0e92ef26c6c88af89da9096289d129effba46e40e69de2"}
Jul 21 00:20:55.881465 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.881096    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r" event={"ID":"dd682a62-3447-4fa7-a79e-a6b1d8693d16","Type":"ContainerStarted","Data":"3e679e8b226ddc44f3864a34d47c8d546f6887b9188c1da524d84fb58e572212"}
Jul 21 00:20:55.895438 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:55.895395    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-zx22r" podStartSLOduration=1.895379406 podStartE2EDuration="1.895379406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:20:55.894533878 +0000 UTC m=+242.252523117" watchObservedRunningTime="2026-07-21 00:20:55.895379406 +0000 UTC m=+242.253368646"
Jul 21 00:20:56.319231 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:56.319188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:56.319392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:56.319261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:56.319392 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:56.319355    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:58.319336457 +0000 UTC m=+244.677325675 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:20:56.319472 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:56.319407    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 00:20:56.319472 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:56.319464    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:20:58.319448462 +0000 UTC m=+244.677437699 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : secret "router-metrics-certs-default" not found
Jul 21 00:20:58.336044 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:58.335986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:58.336044 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:20:58.336053    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:20:58.336582 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:58.336169    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 00:20:58.336582 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:58.336195    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:02.336175192 +0000 UTC m=+248.694164410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:20:58.336582 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:20:58.336217    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:02.336204634 +0000 UTC m=+248.694193865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : secret "router-metrics-certs-default" not found
Jul 21 00:21:00.618689 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.618631    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-flwfg"]
Jul 21 00:21:00.622067 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.622044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.624190 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.624167    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 00:21:00.624372 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.624354    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 00:21:00.624438 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.624420    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tx7qk\""
Jul 21 00:21:00.625030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.625018    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 00:21:00.625084 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.625041    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 00:21:00.636838 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.636817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flwfg"]
Jul 21 00:21:00.754270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.754230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.754270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.754267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.754522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.754311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-crio-socket\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.754522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.754330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2g7p\" (UniqueName: \"kubernetes.io/projected/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-api-access-w2g7p\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.754522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.754348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-data-volume\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855351 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-data-volume\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855509 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855509 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855422    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855509 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855483    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-crio-socket\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855644 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855511    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2g7p\" (UniqueName: \"kubernetes.io/projected/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-api-access-w2g7p\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855644 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:00.855516    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:21:00.855644 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:00.855595    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:01.355578876 +0000 UTC m=+247.713568095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : configmap "kube-rbac-proxy" not found
Jul 21 00:21:00.855644 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:00.855613    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:00.855829 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855611    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-crio-socket\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.855829 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:00.855687    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:01.355653519 +0000 UTC m=+247.713642738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:00.855829 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.855719    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-data-volume\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:00.864083 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:00.864055    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2g7p\" (UniqueName: \"kubernetes.io/projected/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-api-access-w2g7p\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:01.360095 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:01.360060    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:01.360095 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:01.360098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:01.360312 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:01.360197    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:21:01.360312 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:01.360223    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:01.360312 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:01.360266    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:02.360250608 +0000 UTC m=+248.718239845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : configmap "kube-rbac-proxy" not found
Jul 21 00:21:01.360312 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:01.360284    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:02.360277262 +0000 UTC m=+248.718266479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:02.366513 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:02.366477    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:02.366513 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:02.366526    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:02.366545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:02.366565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366620    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366690    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366692    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:10.366646576 +0000 UTC m=+256.724635811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366696    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366718    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:04.366707502 +0000 UTC m=+250.724696722 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : configmap "kube-rbac-proxy" not found
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366732    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:10.366724747 +0000 UTC m=+256.724713970 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : secret "router-metrics-certs-default" not found
Jul 21 00:21:02.367031 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:02.366776    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:04.366758731 +0000 UTC m=+250.724747950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:03.409145 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:03.409120    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8wsn_bb5a13f9-59ec-4300-9180-adeebf1a09e1/dns-node-resolver/0.log"
Jul 21 00:21:04.384448 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:04.384414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:04.384448 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:04.384452    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:04.384654 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.384539    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:21:04.384654 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.384577    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:04.384654 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.384603    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:08.384587698 +0000 UTC m=+254.742576915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : configmap "kube-rbac-proxy" not found
Jul 21 00:21:04.384654 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.384622    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:08.384610965 +0000 UTC m=+254.742600183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:04.408593 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:04.408569    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ldgww_4d6adef2-337e-422e-9537-d0838d2c92c1/node-ca/0.log"
Jul 21 00:21:04.887613 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:04.887571    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:21:04.888044 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.887739    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 21 00:21:04.888044 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:04.887806    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs podName:6de09419-6605-46c9-bc39-24dd00128d61 nodeName:}" failed. No retries permitted until 2026-07-21 00:23:06.88779068 +0000 UTC m=+373.245779898 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs") pod "network-metrics-daemon-h8lxz" (UID: "6de09419-6605-46c9-bc39-24dd00128d61") : secret "metrics-daemon-secret" not found
Jul 21 00:21:05.011261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:05.011230    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dp6c_6167a704-133a-49a1-ba52-4d7d379ca4bf/serve-healthcheck-canary/0.log"
Jul 21 00:21:08.414296 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:08.414257    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:08.414296 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:08.414294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:08.414731 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:08.414389    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 21 00:21:08.414731 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:08.414395    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:08.414731 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:08.414453    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:16.414439765 +0000 UTC m=+262.772428983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : secret "insights-runtime-extractor-tls" not found
Jul 21 00:21:08.414731 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:08.414465    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm podName:fc6dc8d5-b640-4d04-8d01-e1b6978d6460 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:16.414459811 +0000 UTC m=+262.772449028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm") pod "insights-runtime-extractor-flwfg" (UID: "fc6dc8d5-b640-4d04-8d01-e1b6978d6460") : configmap "kube-rbac-proxy" not found
Jul 21 00:21:10.429539 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:10.429494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:10.429990 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:10.429581    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:10.429990 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:10.429660    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle podName:cee23dac-ca85-43fd-9d0a-3c033aaeaad5 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:26.429642932 +0000 UTC m=+272.787632153 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle") pod "router-default-6664cb745d-xdmhp" (UID: "cee23dac-ca85-43fd-9d0a-3c033aaeaad5") : configmap references non-existent config key: service-ca.crt
Jul 21 00:21:10.432043 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:10.432025    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-metrics-certs\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:16.475248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.475197    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:16.475248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.475249    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:16.475927 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.475902    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:16.477692 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.477640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc6dc8d5-b640-4d04-8d01-e1b6978d6460-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-flwfg\" (UID: \"fc6dc8d5-b640-4d04-8d01-e1b6978d6460\") " pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:16.530909 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.530874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-flwfg"
Jul 21 00:21:16.655969 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.655937    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-flwfg"]
Jul 21 00:21:16.659312 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:16.659280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6dc8d5_b640_4d04_8d01_e1b6978d6460.slice/crio-872bfde76ccb988cd37743e474386e2c7f8d55362e52f025a06db9169ad2977c WatchSource:0}: Error finding container 872bfde76ccb988cd37743e474386e2c7f8d55362e52f025a06db9169ad2977c: Status 404 returned error can't find the container with id 872bfde76ccb988cd37743e474386e2c7f8d55362e52f025a06db9169ad2977c
Jul 21 00:21:16.942922 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:16.942881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flwfg" event={"ID":"fc6dc8d5-b640-4d04-8d01-e1b6978d6460","Type":"ContainerStarted","Data":"872bfde76ccb988cd37743e474386e2c7f8d55362e52f025a06db9169ad2977c"}
Jul 21 00:21:21.107976 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.107938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"]
Jul 21 00:21:21.111215 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.111192    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.113521 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.113497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 00:21:21.113952 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.113773    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hclsz\""
Jul 21 00:21:21.113952 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.113856    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 00:21:21.113952 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.113945    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 00:21:21.119639 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.119613    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 00:21:21.125945 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.125915    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"]
Jul 21 00:21:21.214003 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.213968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-bound-sa-token\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214003 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-registry-tls\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214264 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214045    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-image-registry-private-configuration\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214264 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pzrb\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-kube-api-access-2pzrb\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214264 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214234    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de75e08e-f942-4664-9804-5c7ce41323d2-ca-trust-extracted\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214405 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214263    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-registry-certificates\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214405 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-installation-pull-secrets\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.214405 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.214340    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-trusted-ca\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315159 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de75e08e-f942-4664-9804-5c7ce41323d2-ca-trust-extracted\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315159 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-registry-certificates\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-installation-pull-secrets\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-trusted-ca\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-bound-sa-token\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-registry-tls\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-image-registry-private-configuration\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315405    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pzrb\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-kube-api-access-2pzrb\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.315749 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.315603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de75e08e-f942-4664-9804-5c7ce41323d2-ca-trust-extracted\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.316270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.316232    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-registry-certificates\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.316555 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.316272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de75e08e-f942-4664-9804-5c7ce41323d2-trusted-ca\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.318448 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.318419    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-installation-pull-secrets\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.318580 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.318541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de75e08e-f942-4664-9804-5c7ce41323d2-image-registry-private-configuration\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.318747 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.318723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-registry-tls\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.323589 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.323562    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-bound-sa-token\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.324265 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.324220    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pzrb\" (UniqueName: \"kubernetes.io/projected/de75e08e-f942-4664-9804-5c7ce41323d2-kube-api-access-2pzrb\") pod \"image-registry-bdb8bfcf4-dkjq5\" (UID: \"de75e08e-f942-4664-9804-5c7ce41323d2\") " pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.422809 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.422787    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.556532 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.556503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"]
Jul 21 00:21:21.559275 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:21.559250    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde75e08e_f942_4664_9804_5c7ce41323d2.slice/crio-bd645382a9b8d805b1a2dee7a2758bf49be92b0d8ef50356c33f9672358ef6ef WatchSource:0}: Error finding container bd645382a9b8d805b1a2dee7a2758bf49be92b0d8ef50356c33f9672358ef6ef: Status 404 returned error can't find the container with id bd645382a9b8d805b1a2dee7a2758bf49be92b0d8ef50356c33f9672358ef6ef
Jul 21 00:21:21.961323 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.961283    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flwfg" event={"ID":"fc6dc8d5-b640-4d04-8d01-e1b6978d6460","Type":"ContainerStarted","Data":"3f80d25ece20d4598dedeb6e0f1330ae41dc7123c14c437bdfe2fd26f3ba4742"}
Jul 21 00:21:21.962807 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.962776    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" event={"ID":"de75e08e-f942-4664-9804-5c7ce41323d2","Type":"ContainerStarted","Data":"81ad796083f69a889177ccec182f8ceea4a6b8eacad87fe3d91632a76102dfcf"}
Jul 21 00:21:21.962933 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.962824    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" event={"ID":"de75e08e-f942-4664-9804-5c7ce41323d2","Type":"ContainerStarted","Data":"bd645382a9b8d805b1a2dee7a2758bf49be92b0d8ef50356c33f9672358ef6ef"}
Jul 21 00:21:21.962933 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.962890    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:21.984281 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:21.984155    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" podStartSLOduration=0.98413298 podStartE2EDuration="984.13298ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:21.982963504 +0000 UTC m=+268.340952743" watchObservedRunningTime="2026-07-21 00:21:21.98413298 +0000 UTC m=+268.342122223"
Jul 21 00:21:22.178948 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.178898    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-kr7mn"]
Jul 21 00:21:22.182236 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.182209    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:22.185102 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.184802    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 00:21:22.185102 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.184875    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 00:21:22.185102 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.184919    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2kvfl\""
Jul 21 00:21:22.193128 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.193105    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kr7mn"]
Jul 21 00:21:22.324525 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.324332    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csbvm\" (UniqueName: \"kubernetes.io/projected/06ad7b7e-b643-4c69-98e9-0d7f975c7b31-kube-api-access-csbvm\") pod \"downloads-5bc67dcd46-kr7mn\" (UID: \"06ad7b7e-b643-4c69-98e9-0d7f975c7b31\") " pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:22.425614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.425580    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csbvm\" (UniqueName: \"kubernetes.io/projected/06ad7b7e-b643-4c69-98e9-0d7f975c7b31-kube-api-access-csbvm\") pod \"downloads-5bc67dcd46-kr7mn\" (UID: \"06ad7b7e-b643-4c69-98e9-0d7f975c7b31\") " pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:22.437186 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.437156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csbvm\" (UniqueName: \"kubernetes.io/projected/06ad7b7e-b643-4c69-98e9-0d7f975c7b31-kube-api-access-csbvm\") pod \"downloads-5bc67dcd46-kr7mn\" (UID: \"06ad7b7e-b643-4c69-98e9-0d7f975c7b31\") " pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:22.496063 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.496029    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:22.675207 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.675168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kr7mn"]
Jul 21 00:21:22.678827 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:22.678798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ad7b7e_b643_4c69_98e9_0d7f975c7b31.slice/crio-2fed22198158f6997666ac4355044c3fb5c7362cd29428d27c24ceb8c6d4622c WatchSource:0}: Error finding container 2fed22198158f6997666ac4355044c3fb5c7362cd29428d27c24ceb8c6d4622c: Status 404 returned error can't find the container with id 2fed22198158f6997666ac4355044c3fb5c7362cd29428d27c24ceb8c6d4622c
Jul 21 00:21:22.971473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:22.971428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kr7mn" event={"ID":"06ad7b7e-b643-4c69-98e9-0d7f975c7b31","Type":"ContainerStarted","Data":"2fed22198158f6997666ac4355044c3fb5c7362cd29428d27c24ceb8c6d4622c"}
Jul 21 00:21:25.983912 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:25.983873    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flwfg" event={"ID":"fc6dc8d5-b640-4d04-8d01-e1b6978d6460","Type":"ContainerStarted","Data":"15629bfc994d2141a0629e9b6eb2638ee377b7eb6f557cdb1714abe59d3275ee"}
Jul 21 00:21:26.456820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.456781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:26.457486 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.457454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cee23dac-ca85-43fd-9d0a-3c033aaeaad5-service-ca-bundle\") pod \"router-default-6664cb745d-xdmhp\" (UID: \"cee23dac-ca85-43fd-9d0a-3c033aaeaad5\") " pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:26.729817 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.729716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:26.884049 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.884009    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6664cb745d-xdmhp"]
Jul 21 00:21:26.886654 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:26.886617    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee23dac_ca85_43fd_9d0a_3c033aaeaad5.slice/crio-0d35223ee47f758b023b8a165b11ef46e2cad51e66759d2ff2cc0de22bc7e1b7 WatchSource:0}: Error finding container 0d35223ee47f758b023b8a165b11ef46e2cad51e66759d2ff2cc0de22bc7e1b7: Status 404 returned error can't find the container with id 0d35223ee47f758b023b8a165b11ef46e2cad51e66759d2ff2cc0de22bc7e1b7
Jul 21 00:21:26.990186 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.990050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6664cb745d-xdmhp" event={"ID":"cee23dac-ca85-43fd-9d0a-3c033aaeaad5","Type":"ContainerStarted","Data":"f34c98e54753e88135fb06b2956d59de4543b8ca0ee06f213153af60fcc57152"}
Jul 21 00:21:26.990186 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:26.990115    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6664cb745d-xdmhp" event={"ID":"cee23dac-ca85-43fd-9d0a-3c033aaeaad5","Type":"ContainerStarted","Data":"0d35223ee47f758b023b8a165b11ef46e2cad51e66759d2ff2cc0de22bc7e1b7"}
Jul 21 00:21:27.008838 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:27.008786    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6664cb745d-xdmhp" podStartSLOduration=33.008769604 podStartE2EDuration="33.008769604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:20:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:27.0078458 +0000 UTC m=+273.365835041" watchObservedRunningTime="2026-07-21 00:21:27.008769604 +0000 UTC m=+273.366758847"
Jul 21 00:21:27.730305 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:27.730262    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:27.733064 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:27.733033    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:27.994791 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:27.994653    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:27.996380 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:27.996359    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6664cb745d-xdmhp"
Jul 21 00:21:30.004808 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:30.004768    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-flwfg" event={"ID":"fc6dc8d5-b640-4d04-8d01-e1b6978d6460","Type":"ContainerStarted","Data":"6c6d6ba4f2d391ab1f6bdcc5108f1c7d255c31633b7f7e17204ff9bbc4f2a69c"}
Jul 21 00:21:30.020772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:30.020638    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-flwfg" podStartSLOduration=17.661011221 podStartE2EDuration="30.020620464s" totalImagesPullingTime="12.359609243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 00:21:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:30.019857789 +0000 UTC m=+276.377847030" watchObservedRunningTime="2026-07-21 00:21:30.020620464 +0000 UTC m=+276.378609705"
Jul 21 00:21:35.647196 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:35.647132    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bbcdd" podUID="d14d798c-9089-47a2-b04c-3d662970d855"
Jul 21 00:21:36.025024 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:36.024992    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:21:39.082497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.082460    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"]
Jul 21 00:21:39.087486 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.087464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.089733 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.089704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 00:21:39.089891 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.089785    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4dhr2\""
Jul 21 00:21:39.090570 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.090549    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 00:21:39.090660 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.090576    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 00:21:39.090660 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.090584    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 00:21:39.090660 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.090633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 00:21:39.099885 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.099860    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"]
Jul 21 00:21:39.109475 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.109451    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"]
Jul 21 00:21:39.112745 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.112717    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.113879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.113846    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r8qp4"]
Jul 21 00:21:39.114841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.114822    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7jdv2\""
Jul 21 00:21:39.115204 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.115186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 21 00:21:39.115292 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.115266    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 21 00:21:39.115349 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.115269    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 21 00:21:39.117028 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.117012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.118976 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.118956    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zvvjz\""
Jul 21 00:21:39.119073 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.118990    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 00:21:39.119233 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.119212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 00:21:39.119339 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.119253    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 00:21:39.129795 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.129771    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"]
Jul 21 00:21:39.152314 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152285    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vkc\" (UniqueName: \"kubernetes.io/projected/142ce13c-9fd9-4c92-a5ee-8668e46a501d-kube-api-access-67vkc\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.152314 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-textfile\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-sys\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152482    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-tls\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k5hh\" (UniqueName: \"kubernetes.io/projected/18d4116c-d859-43c4-bd99-2826d25ba6c9-kube-api-access-6k5hh\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152600    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvsm\" (UniqueName: \"kubernetes.io/projected/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-api-access-plvsm\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-wtmp\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/142ce13c-9fd9-4c92-a5ee-8668e46a501d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152780    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-metrics-client-ca\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152839    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-root\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.152906 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.153221 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152915    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.153221 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.152969    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.253741 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253703    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/142ce13c-9fd9-4c92-a5ee-8668e46a501d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253751    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-metrics-client-ca\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253785    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-root\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.253935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-root\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.253981    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vkc\" (UniqueName: \"kubernetes.io/projected/142ce13c-9fd9-4c92-a5ee-8668e46a501d-kube-api-access-67vkc\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254079    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-textfile\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254128    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254212    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254263    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-sys\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254290    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-tls\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254312    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k5hh\" (UniqueName: \"kubernetes.io/projected/18d4116c-d859-43c4-bd99-2826d25ba6c9-kube-api-access-6k5hh\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvsm\" (UniqueName: \"kubernetes.io/projected/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-api-access-plvsm\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254443    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-wtmp\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.254584 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-metrics-client-ca\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.255019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254607    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-wtmp\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.255019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/142ce13c-9fd9-4c92-a5ee-8668e46a501d-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.255019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254774    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-textfile\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.255019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/18d4116c-d859-43c4-bd99-2826d25ba6c9-sys\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.255232 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.255165    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.255291 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:39.255274    2576 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 21 00:21:39.255345 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.254854    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-accelerators-collector-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.255345 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:39.255341    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls podName:80c08ff9-979c-4bfd-8d26-ec0c6be89b94 nodeName:}" failed. No retries permitted until 2026-07-21 00:21:39.755322422 +0000 UTC m=+286.113311695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-j6ll5" (UID: "80c08ff9-979c-4bfd-8d26-ec0c6be89b94") : secret "kube-state-metrics-tls" not found
Jul 21 00:21:39.255453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.255413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.257076 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.257050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.257076 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.257072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.257829 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.257784    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/18d4116c-d859-43c4-bd99-2826d25ba6c9-node-exporter-tls\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.257943 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.257834    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.258005 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.257949    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/142ce13c-9fd9-4c92-a5ee-8668e46a501d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.262045 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.262023    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vkc\" (UniqueName: \"kubernetes.io/projected/142ce13c-9fd9-4c92-a5ee-8668e46a501d-kube-api-access-67vkc\") pod \"openshift-state-metrics-79f6958cdf-8p5bm\" (UID: \"142ce13c-9fd9-4c92-a5ee-8668e46a501d\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.263526 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.263491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k5hh\" (UniqueName: \"kubernetes.io/projected/18d4116c-d859-43c4-bd99-2826d25ba6c9-kube-api-access-6k5hh\") pod \"node-exporter-r8qp4\" (UID: \"18d4116c-d859-43c4-bd99-2826d25ba6c9\") " pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.263618 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.263577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvsm\" (UniqueName: \"kubernetes.io/projected/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-api-access-plvsm\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.399060 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.398978    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"
Jul 21 00:21:39.431460 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.431414    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r8qp4"
Jul 21 00:21:39.557210 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.557169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:21:39.559770 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.559746    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d14d798c-9089-47a2-b04c-3d662970d855-metrics-tls\") pod \"dns-default-bbcdd\" (UID: \"d14d798c-9089-47a2-b04c-3d662970d855\") " pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:21:39.628390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.628357    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-26lqt\""
Jul 21 00:21:39.637320 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.637294    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:21:39.758721 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.758684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:39.761507 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:39.761484    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80c08ff9-979c-4bfd-8d26-ec0c6be89b94-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-j6ll5\" (UID: \"80c08ff9-979c-4bfd-8d26-ec0c6be89b94\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:40.024790 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:40.024705    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"
Jul 21 00:21:41.427871 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:41.427837    2576 patch_prober.go:28] interesting pod/image-registry-bdb8bfcf4-dkjq5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 00:21:41.428318 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:41.427894    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" podUID="de75e08e-f942-4664-9804-5c7ce41323d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:21:42.977622 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:42.977582    2576 patch_prober.go:28] interesting pod/image-registry-bdb8bfcf4-dkjq5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 00:21:42.978123 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:42.977662    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" podUID="de75e08e-f942-4664-9804-5c7ce41323d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:21:43.424981 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.424903    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-759db7d569-qpf49"]
Jul 21 00:21:43.428259 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.428241    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.431591 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431422    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 00:21:43.431591 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431434    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 00:21:43.431591 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431447    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tp9kc\""
Jul 21 00:21:43.431591 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431469    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 00:21:43.431591 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431545    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 00:21:43.431971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.431845    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-amedh7t2rl1ih\""
Jul 21 00:21:43.441104 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.441077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759db7d569-qpf49"]
Jul 21 00:21:43.491483 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-tls\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491703 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491503    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69w6h\" (UniqueName: \"kubernetes.io/projected/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-kube-api-access-69w6h\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491703 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491566    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491703 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-client-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-audit-log\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491771    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-metrics-server-audit-profiles\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.491869 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.491805    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-client-certs\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.592921 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.592865    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-audit-log\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.592919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-metrics-server-audit-profiles\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.592963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-client-certs\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.592995    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-tls\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593109 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.593092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69w6h\" (UniqueName: \"kubernetes.io/projected/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-kube-api-access-69w6h\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593325 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.593169    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593325 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.593196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-client-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.593431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.593355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-audit-log\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.594004 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.593975    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.594285 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.594238    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-metrics-server-audit-profiles\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.596189 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.596168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-tls\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.596189 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.596176    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-client-ca-bundle\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.596333 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.596197    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-secret-metrics-server-client-certs\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.601030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.601010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69w6h\" (UniqueName: \"kubernetes.io/projected/7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c-kube-api-access-69w6h\") pod \"metrics-server-759db7d569-qpf49\" (UID: \"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c\") " pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:43.739172 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:43.739128    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:21:45.307792 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.307750    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:21:45.313220 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.313190    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.315623 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.315511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 00:21:45.315623 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.315605    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 00:21:45.315824 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.315683    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 00:21:45.316289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.315935    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 00:21:45.316289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.315926    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8fjq4\""
Jul 21 00:21:45.316289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316096    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 00:21:45.316289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316146    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 00:21:45.316535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316490    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 00:21:45.316588 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316540    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 00:21:45.316649 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316620    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4p4a2r914ibui\""
Jul 21 00:21:45.316716 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316495    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 00:21:45.316755 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316495    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 00:21:45.317006 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316986    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 00:21:45.317083 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.316992    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 00:21:45.317083 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.317050    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 00:21:45.319231 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.319210    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 00:21:45.343689 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.328724    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:21:45.410011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.409976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410031    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410134    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410149    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410170    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410199 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410193    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410249    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410287    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410334    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410383    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410411    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9mkr\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410543    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.410601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.410571    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.501932 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.501887    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18d4116c_d859_43c4_bd99_2826d25ba6c9.slice/crio-83d49edec78d7cb7b610ce222cc1c7fb84dfc967f2b121a56a3fafbc0390c39e WatchSource:0}: Error finding container 83d49edec78d7cb7b610ce222cc1c7fb84dfc967f2b121a56a3fafbc0390c39e: Status 404 returned error can't find the container with id 83d49edec78d7cb7b610ce222cc1c7fb84dfc967f2b121a56a3fafbc0390c39e
Jul 21 00:21:45.511645 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511613    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.511834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511658    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.511834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511717    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.511834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511798    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.511834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511926    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.511977    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512025    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512054    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512083    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512158    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512226    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512323    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.512390 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.512378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9mkr\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.514028 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.513280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.515056 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.515024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.515945 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.515915    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.519450 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.519118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.519450 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.519223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.520924 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.520901    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.522090 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.520923    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.522090 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.520941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.522554 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.522534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.522711 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.521527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.526979 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.525754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.526979 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.526542    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.526979 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.526710    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.526979 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.526950    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.527235 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.527033    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.529537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.527979    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.529537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.528342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.529940 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.529874    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.530634 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.530589    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.532141 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.532118    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9mkr\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr\") pod \"prometheus-k8s-0\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.626129 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.626098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:21:45.686459 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.686428    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-759db7d569-qpf49"]
Jul 21 00:21:45.688305 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.688260    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bbcdd"]
Jul 21 00:21:45.692903 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.692262    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d33e5f5_5d55_49b3_8e9e_cc2857eebe2c.slice/crio-f4445a39742f14485c5e032a58a1bbee83f88bd275c6ff9eb51c7cd71877ee03 WatchSource:0}: Error finding container f4445a39742f14485c5e032a58a1bbee83f88bd275c6ff9eb51c7cd71877ee03: Status 404 returned error can't find the container with id f4445a39742f14485c5e032a58a1bbee83f88bd275c6ff9eb51c7cd71877ee03
Jul 21 00:21:45.692903 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.692516    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14d798c_9089_47a2_b04c_3d662970d855.slice/crio-1a9357b52490a4ad86200b4d45a28eaf89a99fc0ed8cbebc4d75ae8c650eeb6d WatchSource:0}: Error finding container 1a9357b52490a4ad86200b4d45a28eaf89a99fc0ed8cbebc4d75ae8c650eeb6d: Status 404 returned error can't find the container with id 1a9357b52490a4ad86200b4d45a28eaf89a99fc0ed8cbebc4d75ae8c650eeb6d
Jul 21 00:21:45.781261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.781232    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:21:45.782913 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.782878    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44efd0de_a3b9_4a19_82a3_70a7880df673.slice/crio-89d09acc86a90e275aa331c8caa21ce7f8e6656451da9691da4637a0d19aa2fa WatchSource:0}: Error finding container 89d09acc86a90e275aa331c8caa21ce7f8e6656451da9691da4637a0d19aa2fa: Status 404 returned error can't find the container with id 89d09acc86a90e275aa331c8caa21ce7f8e6656451da9691da4637a0d19aa2fa
Jul 21 00:21:45.908555 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.908512    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-j6ll5"]
Jul 21 00:21:45.910989 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:45.910966    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm"]
Jul 21 00:21:45.911595 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.911564    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c08ff9_979c_4bfd_8d26_ec0c6be89b94.slice/crio-951e842a6d54a237ddc1f0a606a451d6974fbe7f4f18070d83c84f067b0b00b2 WatchSource:0}: Error finding container 951e842a6d54a237ddc1f0a606a451d6974fbe7f4f18070d83c84f067b0b00b2: Status 404 returned error can't find the container with id 951e842a6d54a237ddc1f0a606a451d6974fbe7f4f18070d83c84f067b0b00b2
Jul 21 00:21:45.914248 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:21:45.914211    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod142ce13c_9fd9_4c92_a5ee_8668e46a501d.slice/crio-667e1a4b560cc7bf4a7c44f948bb4e7f5f0fd5a24c38f84e2feb50c2cc715613 WatchSource:0}: Error finding container 667e1a4b560cc7bf4a7c44f948bb4e7f5f0fd5a24c38f84e2feb50c2cc715613: Status 404 returned error can't find the container with id 667e1a4b560cc7bf4a7c44f948bb4e7f5f0fd5a24c38f84e2feb50c2cc715613
Jul 21 00:21:46.065030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.064308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759db7d569-qpf49" event={"ID":"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c","Type":"ContainerStarted","Data":"f4445a39742f14485c5e032a58a1bbee83f88bd275c6ff9eb51c7cd71877ee03"}
Jul 21 00:21:46.066515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.066370    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5" event={"ID":"80c08ff9-979c-4bfd-8d26-ec0c6be89b94","Type":"ContainerStarted","Data":"951e842a6d54a237ddc1f0a606a451d6974fbe7f4f18070d83c84f067b0b00b2"}
Jul 21 00:21:46.067783 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.067707    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbcdd" event={"ID":"d14d798c-9089-47a2-b04c-3d662970d855","Type":"ContainerStarted","Data":"1a9357b52490a4ad86200b4d45a28eaf89a99fc0ed8cbebc4d75ae8c650eeb6d"}
Jul 21 00:21:46.070121 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.070066    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"89d09acc86a90e275aa331c8caa21ce7f8e6656451da9691da4637a0d19aa2fa"}
Jul 21 00:21:46.074768 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.072165    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kr7mn" event={"ID":"06ad7b7e-b643-4c69-98e9-0d7f975c7b31","Type":"ContainerStarted","Data":"5993c013e4d7f0521a1059a5154f51e6d9d4a72c4f642feae933d60ce1bc2325"}
Jul 21 00:21:46.075345 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.075144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:46.082274 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.082246    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm" event={"ID":"142ce13c-9fd9-4c92-a5ee-8668e46a501d","Type":"ContainerStarted","Data":"c9703c967d79c80905a9f2a7749217595b931cf1cac79a53397119d9e260844a"}
Jul 21 00:21:46.082431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.082416    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm" event={"ID":"142ce13c-9fd9-4c92-a5ee-8668e46a501d","Type":"ContainerStarted","Data":"667e1a4b560cc7bf4a7c44f948bb4e7f5f0fd5a24c38f84e2feb50c2cc715613"}
Jul 21 00:21:46.082512 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.082502    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8qp4" event={"ID":"18d4116c-d859-43c4-bd99-2826d25ba6c9","Type":"ContainerStarted","Data":"83d49edec78d7cb7b610ce222cc1c7fb84dfc967f2b121a56a3fafbc0390c39e"}
Jul 21 00:21:46.087377 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.087332    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-kr7mn"
Jul 21 00:21:46.091117 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:46.090376    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-kr7mn" podStartSLOduration=1.135680779 podStartE2EDuration="24.090356343s" totalImagesPullingTime="22.954675564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:46.090162686 +0000 UTC m=+292.448151928" watchObservedRunningTime="2026-07-21 00:21:46.090356343 +0000 UTC m=+292.448345584"
Jul 21 00:21:47.096170 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:47.096091    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm" event={"ID":"142ce13c-9fd9-4c92-a5ee-8668e46a501d","Type":"ContainerStarted","Data":"804e14493a55bde3fd49bc3c74d54894f4f30af796eef9d763e9cf22e0b763be"}
Jul 21 00:21:48.101993 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:48.101959    2576 generic.go:356] "Generic (PLEG): container finished" podID="18d4116c-d859-43c4-bd99-2826d25ba6c9" containerID="7f6fd7d3efc36fa296f44e8d20e8432aec0aff67f4fca1bd1041d7b6a0f12324" exitCode=0
Jul 21 00:21:48.102502 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:48.102149    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8qp4" event={"ID":"18d4116c-d859-43c4-bd99-2826d25ba6c9","Type":"ContainerDied","Data":"7f6fd7d3efc36fa296f44e8d20e8432aec0aff67f4fca1bd1041d7b6a0f12324"}
Jul 21 00:21:51.116967 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.116441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-759db7d569-qpf49" event={"ID":"7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c","Type":"ContainerStarted","Data":"5ae84b20847f817b6ae86d32b6781774e4f5269392717f23a71a4e7d41597140"}
Jul 21 00:21:51.118742 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.118713    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5" event={"ID":"80c08ff9-979c-4bfd-8d26-ec0c6be89b94","Type":"ContainerStarted","Data":"4408026bab8680e6ac45d114dadf973c111d39fdff8491133d45c97cbea16d6b"}
Jul 21 00:21:51.121189 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.121112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8qp4" event={"ID":"18d4116c-d859-43c4-bd99-2826d25ba6c9","Type":"ContainerStarted","Data":"5a0db01ec3a9b9fbfd67a58a38e176b03539df77fad41de5ae15d4e74a68ba93"}
Jul 21 00:21:51.145224 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.145166    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-759db7d569-qpf49" podStartSLOduration=2.901711761 podStartE2EDuration="8.145143603s" totalImagesPullingTime="5.243431842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:51.144397463 +0000 UTC m=+297.502386704" watchObservedRunningTime="2026-07-21 00:21:51.145143603 +0000 UTC m=+297.503132844"
Jul 21 00:21:51.429889 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.429844    2576 patch_prober.go:28] interesting pod/image-registry-bdb8bfcf4-dkjq5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 00:21:51.430077 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:51.429914    2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5" podUID="de75e08e-f942-4664-9804-5c7ce41323d2" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:21:52.074504 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:21:52.074462    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-h8lxz" podUID="6de09419-6605-46c9-bc39-24dd00128d61"
Jul 21 00:21:52.128201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.128166    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm" event={"ID":"142ce13c-9fd9-4c92-a5ee-8668e46a501d","Type":"ContainerStarted","Data":"497c11464ce9a4b42f1c083b6c09d1fdf8d0d022d285d3003f125d7d49f9071e"}
Jul 21 00:21:52.130974 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.130945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r8qp4" event={"ID":"18d4116c-d859-43c4-bd99-2826d25ba6c9","Type":"ContainerStarted","Data":"7f96c27d2af937172a00d9d1a285b128abdfa2d2d15d19623c9f93b7a52d08a0"}
Jul 21 00:21:52.133333 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.133305    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5" event={"ID":"80c08ff9-979c-4bfd-8d26-ec0c6be89b94","Type":"ContainerStarted","Data":"4a0133cb701341b7d292e432d1de1340cd9a1be16eaad895cd35e31deab1f2c9"}
Jul 21 00:21:52.133428 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.133364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5" event={"ID":"80c08ff9-979c-4bfd-8d26-ec0c6be89b94","Type":"ContainerStarted","Data":"957df4c01e83268abf0aad11ddee22794eeaa22eb9c07200509e44e6abd1c91d"}
Jul 21 00:21:52.135388 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.135364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbcdd" event={"ID":"d14d798c-9089-47a2-b04c-3d662970d855","Type":"ContainerStarted","Data":"ea10e2330b4825d84049594094576b7ade93a9f9c18e998a9de43b31dea886ce"}
Jul 21 00:21:52.135493 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.135409    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bbcdd" event={"ID":"d14d798c-9089-47a2-b04c-3d662970d855","Type":"ContainerStarted","Data":"1d9a9d05400cc9e7b3c6e70c6192ab081b6961ba047a648547f7daaa431ac7b7"}
Jul 21 00:21:52.135559 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.135487    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:21:52.137286 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.137262    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37" exitCode=0
Jul 21 00:21:52.137383 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.137337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37"}
Jul 21 00:21:52.145110 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.145070    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-8p5bm" podStartSLOduration=8.302947056 podStartE2EDuration="13.145056301s" totalImagesPullingTime="4.842109245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:52.143314556 +0000 UTC m=+298.501303811" watchObservedRunningTime="2026-07-21 00:21:52.145056301 +0000 UTC m=+298.503045540"
Jul 21 00:21:52.158295 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.158246    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bbcdd" podStartSLOduration=257.917969467 podStartE2EDuration="4m23.15822866s" totalImagesPullingTime="5.240259193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:52.157770638 +0000 UTC m=+298.515759878" watchObservedRunningTime="2026-07-21 00:21:52.15822866 +0000 UTC m=+298.516217891"
Jul 21 00:21:52.174781 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.174721    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-j6ll5" podStartSLOduration=8.15240028 podStartE2EDuration="13.174703859s" totalImagesPullingTime="5.022303579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:52.173814124 +0000 UTC m=+298.531803364" watchObservedRunningTime="2026-07-21 00:21:52.174703859 +0000 UTC m=+298.532693102"
Jul 21 00:21:52.191695 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.191616    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r8qp4" podStartSLOduration=11.535313678 podStartE2EDuration="13.191594577s" totalImagesPullingTime="1.487181429s" totalInitContainerRuntime="169.09947ms" isStatefulPod=true podCreationTimestamp="2026-07-21 00:21:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:21:52.190745367 +0000 UTC m=+298.548734609" watchObservedRunningTime="2026-07-21 00:21:52.191594577 +0000 UTC m=+298.549583816"
Jul 21 00:21:52.977922 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:52.977889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-bdb8bfcf4-dkjq5"
Jul 21 00:21:53.979373 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:53.979340    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:21:53.980237 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:53.980211    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:21:53.987076 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:53.987043    2576 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 00:21:56.680612 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:56.680569    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:21:57.161274 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:57.161239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"}
Jul 21 00:21:57.161496 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:21:57.161334    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"}
Jul 21 00:22:00.174810 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.174772    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"}
Jul 21 00:22:00.175270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.174838    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"}
Jul 21 00:22:00.175270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.174863    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"}
Jul 21 00:22:00.175270 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.174887    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerStarted","Data":"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"}
Jul 21 00:22:00.202772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.202700    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.08107009 podStartE2EDuration="15.202661385s" totalImagesPullingTime="12.073318626s" totalInitContainerRuntime="48.272669ms" isStatefulPod=false podCreationTimestamp="2026-07-21 00:21:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:22:00.201405533 +0000 UTC m=+306.559394811" watchObservedRunningTime="2026-07-21 00:22:00.202661385 +0000 UTC m=+306.560650624"
Jul 21 00:22:00.626634 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:00.626596    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:22:02.144177 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:02.144146    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bbcdd"
Jul 21 00:22:03.739419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:03.739382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:22:03.739834 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:03.739479    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:22:06.073808 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:06.073770    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:22:23.745294 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:23.745264    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:22:23.749125 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:23.749100    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-759db7d569-qpf49"
Jul 21 00:22:30.943963 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:30.943930    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6664cb745d-xdmhp_cee23dac-ca85-43fd-9d0a-3c033aaeaad5/router/0.log"
Jul 21 00:22:30.951515 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:30.951488    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dp6c_6167a704-133a-49a1-ba52-4d7d379ca4bf/serve-healthcheck-canary/0.log"
Jul 21 00:22:45.626589 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:45.626480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:22:45.642843 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:45.642816    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:22:46.364513 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:22:46.364483    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:03.760704 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.760652    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.760973    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="prometheus" containerID="cri-o://fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73" gracePeriod=600
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.760993    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy" containerID="cri-o://d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b" gracePeriod=600
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.761018    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="thanos-sidecar" containerID="cri-o://b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa" gracePeriod=600
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.761034    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-web" containerID="cri-o://5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8" gracePeriod=600
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.761065    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="config-reloader" containerID="cri-o://7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1" gracePeriod=600
Jul 21 00:23:03.761239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:03.761079    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-thanos" containerID="cri-o://9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a" gracePeriod=600
Jul 21 00:23:04.421248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421215    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a" exitCode=0
Jul 21 00:23:04.421248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421242    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b" exitCode=0
Jul 21 00:23:04.421248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421249    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa" exitCode=0
Jul 21 00:23:04.421248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421255    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1" exitCode=0
Jul 21 00:23:04.421248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421262    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73" exitCode=0
Jul 21 00:23:04.421531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421287    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"}
Jul 21 00:23:04.421531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"}
Jul 21 00:23:04.421531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"}
Jul 21 00:23:04.421531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421406    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"}
Jul 21 00:23:04.421531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:04.421430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"}
Jul 21 00:23:05.028951 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.028925    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.150228 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150140    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150228 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150181    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150228 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150202    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150228 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150226    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9mkr\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150767 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150788    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150826    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150965 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150892    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150965 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150917    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.150965 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150946    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.151116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.150992    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.151116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.151023    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.151116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.151074    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.151116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.151110    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.151297 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.151143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle\") pod \"44efd0de-a3b9-4a19-82a3-70a7880df673\" (UID: \"44efd0de-a3b9-4a19-82a3-70a7880df673\") "
Jul 21 00:23:05.152698 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.151743    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:23:05.152698 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.152164    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.152698 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.152531    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.153277 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153243    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.153461 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:23:05.153461 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153301    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out" (OuterVolumeSpecName: "config-out") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 00:23:05.153461 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153307    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config" (OuterVolumeSpecName: "config") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.153791 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153603    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.153791 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153781    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.153904 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153815    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.153904 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.153828    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.154743 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.154371    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr" (OuterVolumeSpecName: "kube-api-access-j9mkr") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "kube-api-access-j9mkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:23:05.154864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.154837    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.155225 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.155197    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:23:05.155454 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.155226    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.155898 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.155864    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.156313 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.156287    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.156571 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.156543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.156721 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.156697    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.166018 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.165994    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config" (OuterVolumeSpecName: "web-config") pod "44efd0de-a3b9-4a19-82a3-70a7880df673" (UID: "44efd0de-a3b9-4a19-82a3-70a7880df673"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:23:05.252576 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252535    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9mkr\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-kube-api-access-j9mkr\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252576 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252568    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252576 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252578    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252587    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252598    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252608    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252616    2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-kube-rbac-proxy\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252624    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-metrics-client-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252633    2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252641    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252649    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252658    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-web-config\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252688    2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-grpc-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252697    2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/44efd0de-a3b9-4a19-82a3-70a7880df673-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252705    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/44efd0de-a3b9-4a19-82a3-70a7880df673-tls-assets\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252713    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-config-out\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252721    2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-config\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252728    2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252736    2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/44efd0de-a3b9-4a19-82a3-70a7880df673-secret-metrics-client-certs\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.252841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.252744    2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/44efd0de-a3b9-4a19-82a3-70a7880df673-prometheus-k8s-db\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:23:05.427801 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.427720    2576 generic.go:356] "Generic (PLEG): container finished" podID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerID="5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8" exitCode=0
Jul 21 00:23:05.427801 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.427778    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"}
Jul 21 00:23:05.427801 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.427791    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.427987 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.427841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"44efd0de-a3b9-4a19-82a3-70a7880df673","Type":"ContainerDied","Data":"89d09acc86a90e275aa331c8caa21ce7f8e6656451da9691da4637a0d19aa2fa"}
Jul 21 00:23:05.427987 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.427874    2576 scope.go:117] "RemoveContainer" containerID="9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"
Jul 21 00:23:05.436238 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.436213    2576 scope.go:117] "RemoveContainer" containerID="d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"
Jul 21 00:23:05.443242 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.443218    2576 scope.go:117] "RemoveContainer" containerID="5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"
Jul 21 00:23:05.450078 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.450053    2576 scope.go:117] "RemoveContainer" containerID="b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"
Jul 21 00:23:05.452917 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.452894    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:05.456432 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.456403    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:05.458943 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.458925    2576 scope.go:117] "RemoveContainer" containerID="7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"
Jul 21 00:23:05.465739 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.465723    2576 scope.go:117] "RemoveContainer" containerID="fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"
Jul 21 00:23:05.473259 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.473239    2576 scope.go:117] "RemoveContainer" containerID="97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37"
Jul 21 00:23:05.479983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.479967    2576 scope.go:117] "RemoveContainer" containerID="9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"
Jul 21 00:23:05.480237 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.480218    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a\": container with ID starting with 9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a not found: ID does not exist" containerID="9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"
Jul 21 00:23:05.480296 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480253    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a"} err="failed to get container status \"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a\": rpc error: code = NotFound desc = could not find container \"9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a\": container with ID starting with 9a9a0bdd96872eac3d7cdc68680241cddcd91fd80325aad852074592edd9053a not found: ID does not exist"
Jul 21 00:23:05.480296 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480286    2576 scope.go:117] "RemoveContainer" containerID="d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"
Jul 21 00:23:05.480491 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.480473    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b\": container with ID starting with d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b not found: ID does not exist" containerID="d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"
Jul 21 00:23:05.480528 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480498    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b"} err="failed to get container status \"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b\": rpc error: code = NotFound desc = could not find container \"d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b\": container with ID starting with d9498d2a8a15a6ceb7ff2a7f66d374dbc3bb2925ed47a591f0cd1d1fb0e6476b not found: ID does not exist"
Jul 21 00:23:05.480528 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480517    2576 scope.go:117] "RemoveContainer" containerID="5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"
Jul 21 00:23:05.480759 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.480744    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8\": container with ID starting with 5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8 not found: ID does not exist" containerID="5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"
Jul 21 00:23:05.480820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480761    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8"} err="failed to get container status \"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8\": rpc error: code = NotFound desc = could not find container \"5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8\": container with ID starting with 5f40e5715f4ce0557479e60abae040e73578e075757be0853c4fd32f4b0db6a8 not found: ID does not exist"
Jul 21 00:23:05.480820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480773    2576 scope.go:117] "RemoveContainer" containerID="b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"
Jul 21 00:23:05.480967 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.480953    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa\": container with ID starting with b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa not found: ID does not exist" containerID="b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"
Jul 21 00:23:05.481005 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480970    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa"} err="failed to get container status \"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa\": rpc error: code = NotFound desc = could not find container \"b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa\": container with ID starting with b7aa8719224121858a2a2d889d269c686a0e6d854919b0a5501b7b4de8ae15aa not found: ID does not exist"
Jul 21 00:23:05.481005 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.480982    2576 scope.go:117] "RemoveContainer" containerID="7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"
Jul 21 00:23:05.481357 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.481281    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1\": container with ID starting with 7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1 not found: ID does not exist" containerID="7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"
Jul 21 00:23:05.481357 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.481315    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1"} err="failed to get container status \"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1\": rpc error: code = NotFound desc = could not find container \"7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1\": container with ID starting with 7ddc9c70f50d06bb5904c835a9ab1c9760aa0820049265c01a628918b9730cf1 not found: ID does not exist"
Jul 21 00:23:05.481357 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.481335    2576 scope.go:117] "RemoveContainer" containerID="fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"
Jul 21 00:23:05.481768 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.481738    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73\": container with ID starting with fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73 not found: ID does not exist" containerID="fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"
Jul 21 00:23:05.481864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.481775    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73"} err="failed to get container status \"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73\": rpc error: code = NotFound desc = could not find container \"fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73\": container with ID starting with fe9da0776d070e88d53a021164be32c009b0bb0037ae7dead5595a1240191c73 not found: ID does not exist"
Jul 21 00:23:05.481864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.481796    2576 scope.go:117] "RemoveContainer" containerID="97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37"
Jul 21 00:23:05.482119 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:23:05.482053    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37\": container with ID starting with 97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37 not found: ID does not exist" containerID="97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37"
Jul 21 00:23:05.482119 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.482093    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37"} err="failed to get container status \"97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37\": rpc error: code = NotFound desc = could not find container \"97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37\": container with ID starting with 97058f63c9fef3047a181aa4fdc44d62c20fa62a77949accb397e47b82e90f37 not found: ID does not exist"
Jul 21 00:23:05.483145 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483127    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:05.483410 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483398    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="config-reloader"
Jul 21 00:23:05.483453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483412    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="config-reloader"
Jul 21 00:23:05.483453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483420    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="init-config-reloader"
Jul 21 00:23:05.483453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483428    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="init-config-reloader"
Jul 21 00:23:05.483453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483441    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy"
Jul 21 00:23:05.483453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483447    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483454    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-thanos"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483459    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-thanos"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483467    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="prometheus"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483472    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="prometheus"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483480    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="thanos-sidecar"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483484    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="thanos-sidecar"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483490    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-web"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483494    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-web"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483544    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-web"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483552    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="thanos-sidecar"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483559    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="prometheus"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483565    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy-thanos"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483570    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="config-reloader"
Jul 21 00:23:05.483600 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.483575    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" containerName="kube-rbac-proxy"
Jul 21 00:23:05.489551 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.489527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.491901 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.491882    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 00:23:05.491901 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.491892    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 00:23:05.492041 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.491886    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 00:23:05.492307 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492284    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 00:23:05.492384 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 00:23:05.492384 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492357    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 00:23:05.492488 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492401    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 00:23:05.492488 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492467    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8fjq4\""
Jul 21 00:23:05.492602 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492586    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 00:23:05.492699 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492682    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 00:23:05.492801 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492704    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4p4a2r914ibui\""
Jul 21 00:23:05.492864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492819    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 00:23:05.492864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492836    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 00:23:05.492971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.492750    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 00:23:05.495112 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.495084    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 00:23:05.498721 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.498697    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 00:23:05.506705 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.506661    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:05.554860 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.554824    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.554866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.554888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7fpw\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-kube-api-access-j7fpw\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.554945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.554964    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555146    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555238    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555305    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555361    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.555614 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.555443    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656414 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656388    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656520 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656423    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656520 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656455    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656520 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656469    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656722 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656598    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656722 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656722 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656706    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656734    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656758    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656784    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656813    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656839    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.656931 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656907    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.656966    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657112    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7fpw\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-kube-api-access-j7fpw\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657366 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657909 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.657909 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.657785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.659872 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.659752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.659983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.659922    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.660805 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.660099    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.660805 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.660213    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.660805 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.660227    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.660805 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.660741    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.661064 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.660998    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.661344 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.661319    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.661507 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.661488    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-config\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.662123 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.662103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.662318 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.662295    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a5777842-c9e2-4866-8a7d-d0625670d17f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.662690 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.662639    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a5777842-c9e2-4866-8a7d-d0625670d17f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.662804 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.662788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a5777842-c9e2-4866-8a7d-d0625670d17f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.662911 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.662896    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.665879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.665857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7fpw\" (UniqueName: \"kubernetes.io/projected/a5777842-c9e2-4866-8a7d-d0625670d17f-kube-api-access-j7fpw\") pod \"prometheus-k8s-0\" (UID: \"a5777842-c9e2-4866-8a7d-d0625670d17f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.799719 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.799624    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:23:05.945773 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:05.945749    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 00:23:05.946928 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:23:05.946900    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5777842_c9e2_4866_8a7d_d0625670d17f.slice/crio-d42254c63eda6ea5c5e707917a22699de6f12380de13a5abb277d6c34add6a99 WatchSource:0}: Error finding container d42254c63eda6ea5c5e707917a22699de6f12380de13a5abb277d6c34add6a99: Status 404 returned error can't find the container with id d42254c63eda6ea5c5e707917a22699de6f12380de13a5abb277d6c34add6a99
Jul 21 00:23:06.078866 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.078801    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44efd0de-a3b9-4a19-82a3-70a7880df673" path="/var/lib/kubelet/pods/44efd0de-a3b9-4a19-82a3-70a7880df673/volumes"
Jul 21 00:23:06.433169 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.433084    2576 generic.go:356] "Generic (PLEG): container finished" podID="a5777842-c9e2-4866-8a7d-d0625670d17f" containerID="2872660b3593614d492d38cd1847cecbf16288daf172c80f0b395d68cbd64327" exitCode=0
Jul 21 00:23:06.433298 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.433173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerDied","Data":"2872660b3593614d492d38cd1847cecbf16288daf172c80f0b395d68cbd64327"}
Jul 21 00:23:06.433298 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.433239    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"d42254c63eda6ea5c5e707917a22699de6f12380de13a5abb277d6c34add6a99"}
Jul 21 00:23:06.970104 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.970063    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:23:06.972652 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.972623    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de09419-6605-46c9-bc39-24dd00128d61-metrics-certs\") pod \"network-metrics-daemon-h8lxz\" (UID: \"6de09419-6605-46c9-bc39-24dd00128d61\") " pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:23:06.976883 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.976860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ztz7f\""
Jul 21 00:23:06.984684 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:06.984649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-h8lxz"
Jul 21 00:23:07.113008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.112940    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-h8lxz"]
Jul 21 00:23:07.115550 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:23:07.115516    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de09419_6605_46c9_bc39_24dd00128d61.slice/crio-e66cc6be53a8117ca89ae5cd9c688110ac537a20ca2ff77edb5ed691d4b1c7c3 WatchSource:0}: Error finding container e66cc6be53a8117ca89ae5cd9c688110ac537a20ca2ff77edb5ed691d4b1c7c3: Status 404 returned error can't find the container with id e66cc6be53a8117ca89ae5cd9c688110ac537a20ca2ff77edb5ed691d4b1c7c3
Jul 21 00:23:07.439051 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.439012    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h8lxz" event={"ID":"6de09419-6605-46c9-bc39-24dd00128d61","Type":"ContainerStarted","Data":"e66cc6be53a8117ca89ae5cd9c688110ac537a20ca2ff77edb5ed691d4b1c7c3"}
Jul 21 00:23:07.442399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"29877df72910419d01c9e5436dc3946cffb3df59387839103e6ed869d94756ca"}
Jul 21 00:23:07.442538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442432    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"ee9bd8abc53acff5401026dba6d5ac2d863cfcc36db9a24baab2a078985a1eec"}
Jul 21 00:23:07.442538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442466    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"ae30970ebd6f24fba9f12cdd7c1fbd047284aa5d4dbb5fc2ca8422fe4fa9988c"}
Jul 21 00:23:07.442538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442489    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"acf6d458a41786235e5520d064835432e18a72608a3ea185b9bab74e680bf26b"}
Jul 21 00:23:07.442538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442511    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"4b3b0aaff595fc6bbbe758583ca82b47769927f8900755457882d56631214a0c"}
Jul 21 00:23:07.442538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.442537    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a5777842-c9e2-4866-8a7d-d0625670d17f","Type":"ContainerStarted","Data":"e08c2621d84f99a2fc7dcbf3840547cb2ba6469eb0ffd3aa60c7a996758ac943"}
Jul 21 00:23:07.470101 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:07.470043    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.448732429 podStartE2EDuration="2.470021019s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.28859ms" isStatefulPod=false podCreationTimestamp="2026-07-21 00:23:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:23:07.468578856 +0000 UTC m=+373.826568096" watchObservedRunningTime="2026-07-21 00:23:07.470021019 +0000 UTC m=+373.828010261"
Jul 21 00:23:08.448164 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:08.448125    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h8lxz" event={"ID":"6de09419-6605-46c9-bc39-24dd00128d61","Type":"ContainerStarted","Data":"5c7db565400dfb52b604b6f61d0909328fecf05fcee10a8a81bebbfbe708fbde"}
Jul 21 00:23:08.448623 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:08.448179    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-h8lxz" event={"ID":"6de09419-6605-46c9-bc39-24dd00128d61","Type":"ContainerStarted","Data":"095f4e52fbf8fc7a42c299c26e55819d2d2451d6fd4e62217611862143698d3b"}
Jul 21 00:23:08.471004 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:08.470947    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-h8lxz" podStartSLOduration=373.556940294 podStartE2EDuration="6m14.470929606s" totalImagesPullingTime="913.989312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:23:08.470736263 +0000 UTC m=+374.828725502" watchObservedRunningTime="2026-07-21 00:23:08.470929606 +0000 UTC m=+374.828918846"
Jul 21 00:23:10.800546 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:23:10.800491    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:24:05.800074 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:24:05.800026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:24:05.815660 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:24:05.815636    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:24:06.684522 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:24:06.684494    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 00:25:14.127171 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.127142    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"]
Jul 21 00:25:14.130280 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.130260    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.132568 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.132545    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 00:25:14.133407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.133381    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5b66d\""
Jul 21 00:25:14.133407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.133402    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 00:25:14.133537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.133452    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 00:25:14.133537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.133385    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 00:25:14.133537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.133392    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 00:25:14.141635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.141615    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"]
Jul 21 00:25:14.227687 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.227641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8724eac-5e3d-4587-b969-4b9be84b7281-manager-config\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.227813 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.227694    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-metrics-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.227813 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.227715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.227813 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.227747    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rnxb\" (UniqueName: \"kubernetes.io/projected/c8724eac-5e3d-4587-b969-4b9be84b7281-kube-api-access-9rnxb\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.328239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.328207    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8724eac-5e3d-4587-b969-4b9be84b7281-manager-config\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.328364 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.328245    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-metrics-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.328364 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.328265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.328436 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.328379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rnxb\" (UniqueName: \"kubernetes.io/projected/c8724eac-5e3d-4587-b969-4b9be84b7281-kube-api-access-9rnxb\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.328966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.328911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8724eac-5e3d-4587-b969-4b9be84b7281-manager-config\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.330814 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.330793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-metrics-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.330890 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.330870    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8724eac-5e3d-4587-b969-4b9be84b7281-cert\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.338382 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.338361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rnxb\" (UniqueName: \"kubernetes.io/projected/c8724eac-5e3d-4587-b969-4b9be84b7281-kube-api-access-9rnxb\") pod \"lws-controller-manager-75bcdcf5cd-4ztf9\" (UID: \"c8724eac-5e3d-4587-b969-4b9be84b7281\") " pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.439559 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.439533    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:14.568991 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.568965    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"]
Jul 21 00:25:14.571568 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:25:14.571542    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8724eac_5e3d_4587_b969_4b9be84b7281.slice/crio-c28dd028d9847aee063b28183015f6dd4e16773854c7e600ec889c9a003d23ad WatchSource:0}: Error finding container c28dd028d9847aee063b28183015f6dd4e16773854c7e600ec889c9a003d23ad: Status 404 returned error can't find the container with id c28dd028d9847aee063b28183015f6dd4e16773854c7e600ec889c9a003d23ad
Jul 21 00:25:14.928248 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:14.928161    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9" event={"ID":"c8724eac-5e3d-4587-b969-4b9be84b7281","Type":"ContainerStarted","Data":"c28dd028d9847aee063b28183015f6dd4e16773854c7e600ec889c9a003d23ad"}
Jul 21 00:25:19.541196 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.541163    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"]
Jul 21 00:25:19.544458 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.544443    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.546947 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.546924    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 00:25:19.547066 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.546924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7h555\""
Jul 21 00:25:19.547235 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.547212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 00:25:19.547322 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.547217    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 00:25:19.548202 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.548184    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 00:25:19.558832 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.558810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"]
Jul 21 00:25:19.675839 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.675812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdx5v\" (UniqueName: \"kubernetes.io/projected/646cc8d9-6b32-476d-a763-54ddbddb5bcd-kube-api-access-mdx5v\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.675971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.675854    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-tmp\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.675971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.675880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-manifests\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.675971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.675929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.675971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.675949    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777180 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777156    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-manifests\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777275 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777275 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777219    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777275 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777253    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdx5v\" (UniqueName: \"kubernetes.io/projected/646cc8d9-6b32-476d-a763-54ddbddb5bcd-kube-api-access-mdx5v\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777427 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777305    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-tmp\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.777637 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.777617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-manifests\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.779683 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.779647    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/646cc8d9-6b32-476d-a763-54ddbddb5bcd-tmp\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.779938 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.779919    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-webhook-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.780002 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.779969    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/646cc8d9-6b32-476d-a763-54ddbddb5bcd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.784951 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.784927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdx5v\" (UniqueName: \"kubernetes.io/projected/646cc8d9-6b32-476d-a763-54ddbddb5bcd-kube-api-access-mdx5v\") pod \"opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr\" (UID: \"646cc8d9-6b32-476d-a763-54ddbddb5bcd\") " pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.854577 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.854524    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:19.951734 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.951701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9" event={"ID":"c8724eac-5e3d-4587-b969-4b9be84b7281","Type":"ContainerStarted","Data":"489e6ebf263a4e83b36259cb8ce1862b4963d77d44c2a0d217449f1253146ea8"}
Jul 21 00:25:19.951889 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.951852    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:19.972537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.972491    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9" podStartSLOduration=1.404490144 podStartE2EDuration="5.972476883s" totalImagesPullingTime="4.567986739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:25:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:25:19.970110859 +0000 UTC m=+506.328100093" watchObservedRunningTime="2026-07-21 00:25:19.972476883 +0000 UTC m=+506.330466123"
Jul 21 00:25:19.991659 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:19.991637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"]
Jul 21 00:25:19.994239 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:25:19.994213    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646cc8d9_6b32_476d_a763_54ddbddb5bcd.slice/crio-2524c3dbe38e96e28eb9412a7a8fc8064d8d37ba8dcce5fa590e266cde5cd21b WatchSource:0}: Error finding container 2524c3dbe38e96e28eb9412a7a8fc8064d8d37ba8dcce5fa590e266cde5cd21b: Status 404 returned error can't find the container with id 2524c3dbe38e96e28eb9412a7a8fc8064d8d37ba8dcce5fa590e266cde5cd21b
Jul 21 00:25:20.958888 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:20.958841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr" event={"ID":"646cc8d9-6b32-476d-a763-54ddbddb5bcd","Type":"ContainerStarted","Data":"2524c3dbe38e96e28eb9412a7a8fc8064d8d37ba8dcce5fa590e266cde5cd21b"}
Jul 21 00:25:23.972927 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:23.972888    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr" event={"ID":"646cc8d9-6b32-476d-a763-54ddbddb5bcd","Type":"ContainerStarted","Data":"63603977116f7a32e81ea31c8aaeef6585e3de8c5669034751f60edea6aa16bf"}
Jul 21 00:25:24.977947 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:24.977913    2576 generic.go:356] "Generic (PLEG): container finished" podID="646cc8d9-6b32-476d-a763-54ddbddb5bcd" containerID="63603977116f7a32e81ea31c8aaeef6585e3de8c5669034751f60edea6aa16bf" exitCode=0
Jul 21 00:25:24.978375 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:24.977996    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr" event={"ID":"646cc8d9-6b32-476d-a763-54ddbddb5bcd","Type":"ContainerDied","Data":"63603977116f7a32e81ea31c8aaeef6585e3de8c5669034751f60edea6aa16bf"}
Jul 21 00:25:25.984017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:25.983984    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr" event={"ID":"646cc8d9-6b32-476d-a763-54ddbddb5bcd","Type":"ContainerStarted","Data":"73fc40c7802836e1fbaea0f0dd452c1d1300cc63a52fb84824eecbef696e2420"}
Jul 21 00:25:25.984348 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:25.984062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:26.007204 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:26.007154    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr" podStartSLOduration=2.269384971 podStartE2EDuration="7.007139203s" totalImagesPullingTime="3.707806991s" totalInitContainerRuntime="1.029947241s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:25:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:25:26.004981945 +0000 UTC m=+512.362971187" watchObservedRunningTime="2026-07-21 00:25:26.007139203 +0000 UTC m=+512.365128442"
Jul 21 00:25:30.961411 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:30.961379    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75bcdcf5cd-4ztf9"
Jul 21 00:25:36.990225 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:36.990195    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr"
Jul 21 00:25:47.262386 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.262306    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"]
Jul 21 00:25:47.265473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.265455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.267541 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.267519    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 21 00:25:47.267644 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.267569    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rnl52\""
Jul 21 00:25:47.267644 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.267620    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 21 00:25:47.267644 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.267637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 21 00:25:47.268034 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.268019    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 21 00:25:47.281503 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.281477    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"]
Jul 21 00:25:47.295048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6af712-ed68-4db7-bc79-4e4df2ad465a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295156 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295156 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295157    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295313 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295259    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnls\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-kube-api-access-wvnls\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.295358 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.295318    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396586 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396554    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6af712-ed68-4db7-bc79-4e4df2ad465a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396586 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396588    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396610    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396631    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396762    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnls\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-kube-api-access-wvnls\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.396841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.396835    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.397442 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.397414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.399310 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.399287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.399568 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.399550    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7c6af712-ed68-4db7-bc79-4e4df2ad465a-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.399612 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.399586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.399646 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.399603    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7c6af712-ed68-4db7-bc79-4e4df2ad465a-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.409249 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.409229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.409645 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.409626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnls\" (UniqueName: \"kubernetes.io/projected/7c6af712-ed68-4db7-bc79-4e4df2ad465a-kube-api-access-wvnls\") pod \"istiod-openshift-gateway-94bb8fbfd-gk2q7\" (UID: \"7c6af712-ed68-4db7-bc79-4e4df2ad465a\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.575082 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.575003    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:47.754755 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:25:47.754728    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c6af712_ed68_4db7_bc79_4e4df2ad465a.slice/crio-edcf63ca76d2ebf7d4e74794648230581bf051fc152d14114af4a3f2130fecd8 WatchSource:0}: Error finding container edcf63ca76d2ebf7d4e74794648230581bf051fc152d14114af4a3f2130fecd8: Status 404 returned error can't find the container with id edcf63ca76d2ebf7d4e74794648230581bf051fc152d14114af4a3f2130fecd8
Jul 21 00:25:47.755274 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:47.755253    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"]
Jul 21 00:25:48.078634 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:48.078600    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7" event={"ID":"7c6af712-ed68-4db7-bc79-4e4df2ad465a","Type":"ContainerStarted","Data":"edcf63ca76d2ebf7d4e74794648230581bf051fc152d14114af4a3f2130fecd8"}
Jul 21 00:25:50.014021 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:50.013980    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 00:25:50.014315 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:50.014057    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 21 00:25:50.084716 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:50.084687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7" event={"ID":"7c6af712-ed68-4db7-bc79-4e4df2ad465a","Type":"ContainerStarted","Data":"bdb413314cc36514799dd522457332381e7b1d25b6535a13ce536fd303470202"}
Jul 21 00:25:50.084837 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:50.084814    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:25:50.115793 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:50.115737    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7" podStartSLOduration=0.858601173 podStartE2EDuration="3.11572086s" totalImagesPullingTime="2.257119687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:25:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:25:50.114210224 +0000 UTC m=+536.472199466" watchObservedRunningTime="2026-07-21 00:25:50.11572086 +0000 UTC m=+536.473710101"
Jul 21 00:25:51.090734 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:51.090703    2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-gk2q7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 21 00:25:51.091077 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:51.090752    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7" podUID="7c6af712-ed68-4db7-bc79-4e4df2ad465a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 00:25:54.090658 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:25:54.090632    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-gk2q7"
Jul 21 00:26:54.006687 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:26:54.006643    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:26:54.007167 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:26:54.006652    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:28:26.554005 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.553961    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:28:26.557626 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.557604    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.559741 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.559713    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 00:28:26.559854 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.559837    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 00:28:26.559908 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.559840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xfbv5\""
Jul 21 00:28:26.560577 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.560555    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 00:28:26.566882 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.566863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:28:26.603251 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.603228    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:28:26.619878 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.619857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlc4c\" (UniqueName: \"kubernetes.io/projected/72527586-087e-4141-9cef-ddb71e102e52-kube-api-access-hlc4c\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.619963 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.619887    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72527586-087e-4141-9cef-ddb71e102e52-config-file\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.720630 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.720594    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlc4c\" (UniqueName: \"kubernetes.io/projected/72527586-087e-4141-9cef-ddb71e102e52-kube-api-access-hlc4c\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.720777 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.720634    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72527586-087e-4141-9cef-ddb71e102e52-config-file\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.721258 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.721234    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/72527586-087e-4141-9cef-ddb71e102e52-config-file\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.728313 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.728292    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlc4c\" (UniqueName: \"kubernetes.io/projected/72527586-087e-4141-9cef-ddb71e102e52-kube-api-access-hlc4c\") pod \"limitador-limitador-54d6d988d5-6fff5\" (UID: \"72527586-087e-4141-9cef-ddb71e102e52\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.870272 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.870221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:26.998418 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:26.998383    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:28:27.001876 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:28:27.001850    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72527586_087e_4141_9cef_ddb71e102e52.slice/crio-5416c4b229e5668c11b44e7f90ba8e9b858a78057fd815407f28ba77a50a744b WatchSource:0}: Error finding container 5416c4b229e5668c11b44e7f90ba8e9b858a78057fd815407f28ba77a50a744b: Status 404 returned error can't find the container with id 5416c4b229e5668c11b44e7f90ba8e9b858a78057fd815407f28ba77a50a744b
Jul 21 00:28:27.003695 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:27.003662    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:28:27.734282 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:27.734241    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5" event={"ID":"72527586-087e-4141-9cef-ddb71e102e52","Type":"ContainerStarted","Data":"5416c4b229e5668c11b44e7f90ba8e9b858a78057fd815407f28ba77a50a744b"}
Jul 21 00:28:29.744535 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:29.744500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5" event={"ID":"72527586-087e-4141-9cef-ddb71e102e52","Type":"ContainerStarted","Data":"f696896becf2819344f5ade7ebd0dbc376ff37fadd0962605c6cdb3de5f369fd"}
Jul 21 00:28:29.745012 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:29.744625    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:28:29.759440 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:29.759397    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5" podStartSLOduration=1.203950986 podStartE2EDuration="3.759384252s" totalImagesPullingTime="2.555433266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:28:29.758636569 +0000 UTC m=+696.116625810" watchObservedRunningTime="2026-07-21 00:28:29.759384252 +0000 UTC m=+696.117373492"
Jul 21 00:28:40.752993 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:28:40.752962    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6fff5"
Jul 21 00:29:36.371033 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:29:36.370996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:29:57.605179 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:29:57.605142    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:30:05.844153 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:05.844122    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:30:20.303177 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:20.303149    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:30:31.454446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.454406    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"]
Jul 21 00:30:31.458139 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.458119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.461300 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.461279    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m5dwj\""
Jul 21 00:30:31.461419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.461278    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 00:30:31.461419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.461319    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 00:30:31.461419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.461380    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 21 00:30:31.467718 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.467695    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"]
Jul 21 00:30:31.537312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537278    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.537479 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86lx7\" (UniqueName: \"kubernetes.io/projected/eb3b6f42-d157-4526-b966-a5eb9ee6323b-kube-api-access-86lx7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.537479 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537344    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.537479 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.537479 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537447    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.537608 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.537485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638571 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638522    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638590    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86lx7\" (UniqueName: \"kubernetes.io/projected/eb3b6f42-d157-4526-b966-a5eb9ee6323b-kube-api-access-86lx7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638693    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638746    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.638772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.638769    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.639057 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.639034    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.639117 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.639082    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.639163 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.639112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.641033 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.641015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb3b6f42-d157-4526-b966-a5eb9ee6323b-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.641225 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.641207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb3b6f42-d157-4526-b966-a5eb9ee6323b-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.646694 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.646656    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86lx7\" (UniqueName: \"kubernetes.io/projected/eb3b6f42-d157-4526-b966-a5eb9ee6323b-kube-api-access-86lx7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k\" (UID: \"eb3b6f42-d157-4526-b966-a5eb9ee6323b\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.769702 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.769596    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:31.906375 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:31.906302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"]
Jul 21 00:30:31.908563 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:30:31.908537    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb3b6f42_d157_4526_b966_a5eb9ee6323b.slice/crio-7619b247e40ab68b4aa0293eb9cead6ab32a35682fa9390e68771f411fc0bcb5 WatchSource:0}: Error finding container 7619b247e40ab68b4aa0293eb9cead6ab32a35682fa9390e68771f411fc0bcb5: Status 404 returned error can't find the container with id 7619b247e40ab68b4aa0293eb9cead6ab32a35682fa9390e68771f411fc0bcb5
Jul 21 00:30:32.262820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:32.262777    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k" event={"ID":"eb3b6f42-d157-4526-b966-a5eb9ee6323b","Type":"ContainerStarted","Data":"7619b247e40ab68b4aa0293eb9cead6ab32a35682fa9390e68771f411fc0bcb5"}
Jul 21 00:30:33.004466 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:33.004433    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:30:33.268438 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:33.268398    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k" event={"ID":"eb3b6f42-d157-4526-b966-a5eb9ee6323b","Type":"ContainerStarted","Data":"e698e6a7c88054c2eb22bd18c0c2dbbad437006acef3160aa112830c33168988"}
Jul 21 00:30:33.289738 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:33.289615    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k" podStartSLOduration=1.27949191 podStartE2EDuration="2.289600316s" totalImagesPullingTime="1.010108406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:30:33.287571851 +0000 UTC m=+819.645561090" watchObservedRunningTime="2026-07-21 00:30:33.289600316 +0000 UTC m=+819.647589555"
Jul 21 00:30:41.770188 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:41.770136    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:41.770695 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:41.770239    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:41.782943 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:41.782919    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:42.319098 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:42.319070    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k"
Jul 21 00:30:49.408065 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:30:49.408028    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:31:05.006562 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:31:05.006526    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:31:54.037211 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:31:54.037123    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:31:54.038955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:31:54.038934    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:32:34.927475 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:32:34.927438    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:32:45.509306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:32:45.509274    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:32:56.019289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:32:56.019253    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:34:36.847077 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:34:36.847041    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:34:46.193944 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:34:46.193850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:34:59.702680 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:34:59.702642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:35:16.493124 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:35:16.493093    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:35:26.092772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:35:26.092736    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:35:36.603198 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:35:36.603169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:35:44.295554 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:35:44.295525    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:35:56.315856 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:35:56.315811    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:36:05.394223 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:05.394184    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:36:16.415830 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:16.415799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:36:26.385173 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:26.385140    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:36:51.798748 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:51.798714    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:36:54.062182 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:54.062154    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:36:54.064971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:36:54.064941    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:37:01.799715 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:37:01.799655    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:37:25.812763 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:37:25.812726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:37:36.899547 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:37:36.899506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:37:51.408220 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:37:51.408129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:38:01.442090 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:38:01.442057    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:38:11.191166 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:38:11.191131    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:38:21.002102 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:38:20.997949    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:38:30.792741 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:38:30.792702    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:40:21.700678 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:40:21.700642    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:40:33.917274 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:40:33.917242    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:40:42.702161 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:40:42.702129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:40:54.402342 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:40:54.402271    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:05.995511 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:05.995477    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:16.799374 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:16.799338    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:25.297306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:25.297276    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:38.597741 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:38.597704    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:48.049700 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:48.049651    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:41:54.088407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:54.088380    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:41:54.090585 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:54.090564    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:41:56.600637 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:41:56.600602    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:42:07.696879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:42:07.696842    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:42:28.898328 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:42:28.898291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:42:38.891604 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:42:38.891569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:42:52.396201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:42:52.396168    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:43:28.792949 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:43:28.792914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:43:43.288491 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:43:43.288460    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:43:53.594754 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:43:53.594717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:05.399581 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:05.399544    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:15.394867 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:15.394831    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:25.090407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:25.090375    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:33.297340 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:33.297311    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:42.997602 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:42.997564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:44:53.090896 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:44:53.090863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:06.589488 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:06.589454    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:15.697557 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:15.697476    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:25.791291 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:25.791255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:35.292446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:35.292409    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:48.489076 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:48.489032    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:45:56.391111 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:45:56.391077    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:46:08.599685 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:08.599641    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:46:20.402400 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:20.402358    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:46:29.793027 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:29.792990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:46:42.901062 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:42.901026    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:46:54.118928 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:54.118903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:46:54.122632 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:54.122611    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:46:54.193305 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:46:54.193275    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:47:03.800966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:03.800926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:47:06.045172 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.045138    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:06.048464 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.048445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.050945 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.050924    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-865fdc2c-serving-cert\""
Jul 21 00:47:06.051045 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.050963    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:47:06.051298 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.051274    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:47:06.051861 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.051844    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:47:06.058609 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.058589    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:06.187982 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.187950    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jpf\" (UniqueName: \"kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.188136 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.187994    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.188136 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.188088    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.289196 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.289168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.289324 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.289218    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jpf\" (UniqueName: \"kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.289324 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.289243    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.289806 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.289787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.291704 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.291685    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.297333 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.297278    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jpf\" (UniqueName: \"kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf\") pod \"maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.360197 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.360172    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:06.494219 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.494185    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:06.496703 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:47:06.496662    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9808a3_ea09_4125_9ffb_bdb052c5197e.slice/crio-e2c35a317d8d2016345663041048527f283efa29649d96c25e40ae2e67933da5 WatchSource:0}: Error finding container e2c35a317d8d2016345663041048527f283efa29649d96c25e40ae2e67933da5: Status 404 returned error can't find the container with id e2c35a317d8d2016345663041048527f283efa29649d96c25e40ae2e67933da5
Jul 21 00:47:06.497921 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:06.497889    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:47:07.495469 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:07.495422    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" event={"ID":"7c9808a3-ea09-4125-9ffb-bdb052c5197e","Type":"ContainerStarted","Data":"e2c35a317d8d2016345663041048527f283efa29649d96c25e40ae2e67933da5"}
Jul 21 00:47:09.505384 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:09.505346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" event={"ID":"7c9808a3-ea09-4125-9ffb-bdb052c5197e","Type":"ContainerStarted","Data":"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"}
Jul 21 00:47:09.505786 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:09.505442    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:09.522491 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:09.522430    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" podStartSLOduration=0.849744154 podStartE2EDuration="3.52241104s" totalImagesPullingTime="2.672666886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:47:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:47:09.52077837 +0000 UTC m=+1815.878767638" watchObservedRunningTime="2026-07-21 00:47:09.52241104 +0000 UTC m=+1815.880400281"
Jul 21 00:47:15.090164 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:15.090132    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:47:15.514323 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:15.514296    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:42.134425 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.134394    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:42.138870 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.134605    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" podUID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" containerName="maas-api" containerID="cri-o://97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045" gracePeriod=30
Jul 21 00:47:42.384365 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.384337    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:42.488394 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.488365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls\") pod \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") "
Jul 21 00:47:42.488543 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.488403    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca\") pod \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") "
Jul 21 00:47:42.488543 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.488441    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8jpf\" (UniqueName: \"kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf\") pod \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\" (UID: \"7c9808a3-ea09-4125-9ffb-bdb052c5197e\") "
Jul 21 00:47:42.488765 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.488743    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7c9808a3-ea09-4125-9ffb-bdb052c5197e" (UID: "7c9808a3-ea09-4125-9ffb-bdb052c5197e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:47:42.490694 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.490641    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7c9808a3-ea09-4125-9ffb-bdb052c5197e" (UID: "7c9808a3-ea09-4125-9ffb-bdb052c5197e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:47:42.490694 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.490683    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf" (OuterVolumeSpecName: "kube-api-access-g8jpf") pod "7c9808a3-ea09-4125-9ffb-bdb052c5197e" (UID: "7c9808a3-ea09-4125-9ffb-bdb052c5197e"). InnerVolumeSpecName "kube-api-access-g8jpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:47:42.589269 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.589235    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7c9808a3-ea09-4125-9ffb-bdb052c5197e-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:47:42.589269 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.589268    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c9808a3-ea09-4125-9ffb-bdb052c5197e-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:47:42.589269 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.589277    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8jpf\" (UniqueName: \"kubernetes.io/projected/7c9808a3-ea09-4125-9ffb-bdb052c5197e-kube-api-access-g8jpf\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:47:42.656376 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.656348    2576 generic.go:356] "Generic (PLEG): container finished" podID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" containerID="97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045" exitCode=0
Jul 21 00:47:42.656473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.656398    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"
Jul 21 00:47:42.656473 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.656435    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" event={"ID":"7c9808a3-ea09-4125-9ffb-bdb052c5197e","Type":"ContainerDied","Data":"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"}
Jul 21 00:47:42.656557 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.656483    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg" event={"ID":"7c9808a3-ea09-4125-9ffb-bdb052c5197e","Type":"ContainerDied","Data":"e2c35a317d8d2016345663041048527f283efa29649d96c25e40ae2e67933da5"}
Jul 21 00:47:42.656557 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.656511    2576 scope.go:117] "RemoveContainer" containerID="97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"
Jul 21 00:47:42.665239 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.665220    2576 scope.go:117] "RemoveContainer" containerID="97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"
Jul 21 00:47:42.665491 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:47:42.665470    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045\": container with ID starting with 97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045 not found: ID does not exist" containerID="97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"
Jul 21 00:47:42.665557 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.665502    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045"} err="failed to get container status \"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045\": rpc error: code = NotFound desc = could not find container \"97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045\": container with ID starting with 97ec8c67a140ba098585f3965b9602135ca39bb15dfe78dd9fe54d11ff5a2045 not found: ID does not exist"
Jul 21 00:47:42.677040 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.677015    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:42.680610 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:42.680590    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-865fdc2c-798f7c65c-cvjmg"]
Jul 21 00:47:44.079421 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:44.079389    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" path="/var/lib/kubelet/pods/7c9808a3-ea09-4125-9ffb-bdb052c5197e/volumes"
Jul 21 00:47:45.300629 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:45.300591    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:47:50.664875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.664844    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:47:50.665356 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.665336    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" containerName="maas-api"
Jul 21 00:47:50.665431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.665359    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" containerName="maas-api"
Jul 21 00:47:50.665492 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.665478    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9808a3-ea09-4125-9ffb-bdb052c5197e" containerName="maas-api"
Jul 21 00:47:50.670534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.670513    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.674190 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.674171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-c7cbed04-serving-cert\""
Jul 21 00:47:50.674474 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.674455    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:47:50.674583 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.674509    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:47:50.674760 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.674744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:47:50.688848 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.688828    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:47:50.762393 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.762370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hp8m\" (UniqueName: \"kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.762519 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.762413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.762519 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.762456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.863361 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.863332    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hp8m\" (UniqueName: \"kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.863539 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.863373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.863539 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.863402    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.863539 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:47:50.863498    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-serving-cert: secret "maas-api-e2e-migrate-c7cbed04-serving-cert" not found
Jul 21 00:47:50.863724 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:47:50.863587    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls podName:00b3503e-b7ff-42ee-b2e1-9e72fd8018e8 nodeName:}" failed. No retries permitted until 2026-07-21 00:47:51.363568144 +0000 UTC m=+1857.721557373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls") pod "maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" (UID: "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8") : secret "maas-api-e2e-migrate-c7cbed04-serving-cert" not found
Jul 21 00:47:50.864002 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.863982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:50.875973 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:50.875943    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hp8m\" (UniqueName: \"kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:51.368726 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:51.368691    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:51.371247 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:51.371217    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") pod \"maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:51.580602 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:51.580571    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:51.713280 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:51.713254    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:47:51.714613 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:47:51.714583    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b3503e_b7ff_42ee_b2e1_9e72fd8018e8.slice/crio-132fd3375ca266c2e20476ac9a0401ff75d57560a8279a62e42774d8ea7a3932 WatchSource:0}: Error finding container 132fd3375ca266c2e20476ac9a0401ff75d57560a8279a62e42774d8ea7a3932: Status 404 returned error can't find the container with id 132fd3375ca266c2e20476ac9a0401ff75d57560a8279a62e42774d8ea7a3932
Jul 21 00:47:52.700852 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:52.700818    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" event={"ID":"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8","Type":"ContainerStarted","Data":"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"}
Jul 21 00:47:52.701002 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:52.700867    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" event={"ID":"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8","Type":"ContainerStarted","Data":"132fd3375ca266c2e20476ac9a0401ff75d57560a8279a62e42774d8ea7a3932"}
Jul 21 00:47:52.701002 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:52.700930    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:47:52.717625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:52.717578    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" podStartSLOduration=2.209110376 podStartE2EDuration="2.717566218s" totalImagesPullingTime="508.455842ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:47:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:47:52.715878953 +0000 UTC m=+1859.073868194" watchObservedRunningTime="2026-07-21 00:47:52.717566218 +0000 UTC m=+1859.075555457"
Jul 21 00:47:56.512849 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:56.512817    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:47:58.709997 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:47:58.709969    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:48:15.455101 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.455023    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"]
Jul 21 00:48:15.458588 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.458572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:15.460654 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.460634    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:48:15.464879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.464853    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"]
Jul 21 00:48:15.567230 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.567187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj\" (UID: \"30c2b014-138c-4e00-a9b1-0078af27e77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:15.668394 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.668353    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj\" (UID: \"30c2b014-138c-4e00-a9b1-0078af27e77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:15.669029 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.669005    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj\" (UID: \"30c2b014-138c-4e00-a9b1-0078af27e77d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:15.770511 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.770427    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:15.900201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:15.900176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"]
Jul 21 00:48:15.902620 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:48:15.902594    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30c2b014_138c_4e00_a9b1_0078af27e77d.slice/crio-e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0 WatchSource:0}: Error finding container e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0: Status 404 returned error can't find the container with id e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0
Jul 21 00:48:16.805265 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:16.805228    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj" event={"ID":"30c2b014-138c-4e00-a9b1-0078af27e77d","Type":"ContainerStarted","Data":"e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0"}
Jul 21 00:48:18.814722 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:18.814658    2576 generic.go:356] "Generic (PLEG): container finished" podID="30c2b014-138c-4e00-a9b1-0078af27e77d" containerID="ade156b855e4323e131c2f429174491010341968729cb2cbe7101209b049c799" exitCode=0
Jul 21 00:48:18.814722 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:18.814706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj" event={"ID":"30c2b014-138c-4e00-a9b1-0078af27e77d","Type":"ContainerDied","Data":"ade156b855e4323e131c2f429174491010341968729cb2cbe7101209b049c799"}
Jul 21 00:48:19.949367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:19.949347    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:20.102518 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.102451    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca\") pod \"30c2b014-138c-4e00-a9b1-0078af27e77d\" (UID: \"30c2b014-138c-4e00-a9b1-0078af27e77d\") "
Jul 21 00:48:20.102792 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.102771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30c2b014-138c-4e00-a9b1-0078af27e77d" (UID: "30c2b014-138c-4e00-a9b1-0078af27e77d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:48:20.203168 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.203142    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30c2b014-138c-4e00-a9b1-0078af27e77d-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:48:20.824630 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.824603    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"
Jul 21 00:48:20.824831 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.824605    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj" event={"ID":"30c2b014-138c-4e00-a9b1-0078af27e77d","Type":"ContainerDied","Data":"e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0"}
Jul 21 00:48:20.824831 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:20.824721    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8be1c0ceec6350adf6dc24fa9c00866745504e9a83ae17e3d35b3c30b2b43a0"
Jul 21 00:48:26.205645 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.205613    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:48:26.206012 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.205864    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" podUID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" containerName="maas-api" containerID="cri-o://f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803" gracePeriod=30
Jul 21 00:48:26.452782 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.452757    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:48:26.559969 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.559887    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") pod \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") "
Jul 21 00:48:26.560123 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.559989    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca\") pod \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") "
Jul 21 00:48:26.560123 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.560035    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hp8m\" (UniqueName: \"kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m\") pod \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\" (UID: \"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8\") "
Jul 21 00:48:26.560309 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.560285    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" (UID: "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:48:26.561832 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.561809    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" (UID: "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:48:26.562168 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.562146    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m" (OuterVolumeSpecName: "kube-api-access-9hp8m") pod "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" (UID: "00b3503e-b7ff-42ee-b2e1-9e72fd8018e8"). InnerVolumeSpecName "kube-api-access-9hp8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:48:26.661454 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.661427    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:48:26.661454 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.661450    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:48:26.661597 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.661460    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hp8m\" (UniqueName: \"kubernetes.io/projected/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8-kube-api-access-9hp8m\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:48:26.850272 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.850188    2576 generic.go:356] "Generic (PLEG): container finished" podID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" containerID="f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803" exitCode=0
Jul 21 00:48:26.850272 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.850228    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"
Jul 21 00:48:26.850439 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.850275    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" event={"ID":"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8","Type":"ContainerDied","Data":"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"}
Jul 21 00:48:26.850439 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.850319    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn" event={"ID":"00b3503e-b7ff-42ee-b2e1-9e72fd8018e8","Type":"ContainerDied","Data":"132fd3375ca266c2e20476ac9a0401ff75d57560a8279a62e42774d8ea7a3932"}
Jul 21 00:48:26.850439 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.850339    2576 scope.go:117] "RemoveContainer" containerID="f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"
Jul 21 00:48:26.859074 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.859057    2576 scope.go:117] "RemoveContainer" containerID="f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"
Jul 21 00:48:26.859310 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:48:26.859292    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803\": container with ID starting with f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803 not found: ID does not exist" containerID="f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"
Jul 21 00:48:26.859367 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.859322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803"} err="failed to get container status \"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803\": rpc error: code = NotFound desc = could not find container \"f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803\": container with ID starting with f7fef9de6273d617e906d16f0cd377fef86cd52af44efe6782f88770dcc3e803 not found: ID does not exist"
Jul 21 00:48:26.872310 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.872289    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:48:26.880129 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:26.880112    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-c7cbed04-5c4b549f9f-v4jmn"]
Jul 21 00:48:28.079477 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:28.079445    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" path="/var/lib/kubelet/pods/00b3503e-b7ff-42ee-b2e1-9e72fd8018e8/volumes"
Jul 21 00:48:29.108403 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:29.108365    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:48:30.541955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:30.541921    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"]
Jul 21 00:48:30.547297 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:30.547273    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c7cbed04-qp8xj"]
Jul 21 00:48:32.079170 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:32.079135    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30c2b014-138c-4e00-a9b1-0078af27e77d" path="/var/lib/kubelet/pods/30c2b014-138c-4e00-a9b1-0078af27e77d/volumes"
Jul 21 00:48:33.628950 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.628912    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:48:33.629413 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629398    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30c2b014-138c-4e00-a9b1-0078af27e77d" containerName="revoke-keys"
Jul 21 00:48:33.629468 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629417    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30c2b014-138c-4e00-a9b1-0078af27e77d" containerName="revoke-keys"
Jul 21 00:48:33.629468 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629429    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" containerName="maas-api"
Jul 21 00:48:33.629468 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629438    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" containerName="maas-api"
Jul 21 00:48:33.629568 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629517    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30c2b014-138c-4e00-a9b1-0078af27e77d" containerName="revoke-keys"
Jul 21 00:48:33.629568 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.629533    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b3503e-b7ff-42ee-b2e1-9e72fd8018e8" containerName="maas-api"
Jul 21 00:48:33.634379 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.634351    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.636971 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.636948    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e23578bb-serving-cert\""
Jul 21 00:48:33.637197 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.637178    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:48:33.637370 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.637352    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:48:33.637431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.637359    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:48:33.649268 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.649247    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:48:33.713511 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.713478    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.713689 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.713522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78xsz\" (UniqueName: \"kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.713689 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.713552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.814088 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.814055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.814258 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.814101    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78xsz\" (UniqueName: \"kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.814258 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.814121    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.814809 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.814777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.816635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.816619    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.829163 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.829139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78xsz\" (UniqueName: \"kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz\") pod \"maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:33.944525 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:33.944495    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:34.081229 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:34.081204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:48:34.082519 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:48:34.082491    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4c9c43_1a54_4530_ad64_508a2b60803d.slice/crio-247186de3564238fdb89dba4c7a7a8b7763b037d5071338758c1f3e7a48e7bef WatchSource:0}: Error finding container 247186de3564238fdb89dba4c7a7a8b7763b037d5071338758c1f3e7a48e7bef: Status 404 returned error can't find the container with id 247186de3564238fdb89dba4c7a7a8b7763b037d5071338758c1f3e7a48e7bef
Jul 21 00:48:34.885079 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:34.885039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" event={"ID":"5d4c9c43-1a54-4530-ad64-508a2b60803d","Type":"ContainerStarted","Data":"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"}
Jul 21 00:48:34.885459 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:34.885137    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" event={"ID":"5d4c9c43-1a54-4530-ad64-508a2b60803d","Type":"ContainerStarted","Data":"247186de3564238fdb89dba4c7a7a8b7763b037d5071338758c1f3e7a48e7bef"}
Jul 21 00:48:34.885459 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:34.885168    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:34.902948 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:34.902894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" podStartSLOduration=1.28698818 podStartE2EDuration="1.902878575s" totalImagesPullingTime="615.890395ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:48:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:48:34.901899362 +0000 UTC m=+1901.259888611" watchObservedRunningTime="2026-07-21 00:48:34.902878575 +0000 UTC m=+1901.260867815"
Jul 21 00:48:40.093890 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:40.093861    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:48:40.894719 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:40.894692    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:48:59.432635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.432600    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"]
Jul 21 00:48:59.435802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.435785    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:48:59.438075 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.438051    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:48:59.443831 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.443809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"]
Jul 21 00:48:59.524211 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.524175    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e23578bb-drmmm\" (UID: \"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:48:59.625234 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.625198    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e23578bb-drmmm\" (UID: \"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:48:59.625835 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.625814    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-e23578bb-drmmm\" (UID: \"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:48:59.747618 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:48:59.747584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:49:00.087648 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:49:00.087618    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfaa9792_57ca_4b82_bdeb_5bf0a97d376a.slice/crio-32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a WatchSource:0}: Error finding container 32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a: Status 404 returned error can't find the container with id 32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a
Jul 21 00:49:00.089620 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:00.089588    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"]
Jul 21 00:49:00.999941 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:00.999899    2576 generic.go:356] "Generic (PLEG): container finished" podID="cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" containerID="e5cab2611297fbe2292b1f485ecc3cec62872f43672c3a380432f5eb5b91aeea" exitCode=0
Jul 21 00:49:01.000301 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:00.999961    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm" event={"ID":"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a","Type":"ContainerDied","Data":"e5cab2611297fbe2292b1f485ecc3cec62872f43672c3a380432f5eb5b91aeea"}
Jul 21 00:49:01.000301 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:01.000013    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm" event={"ID":"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a","Type":"ContainerStarted","Data":"32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a"}
Jul 21 00:49:02.140267 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:02.140245    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:49:02.244316 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:02.244286    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca\") pod \"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a\" (UID: \"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a\") "
Jul 21 00:49:02.244575 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:02.244557    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" (UID: "cfaa9792-57ca-4b82-bdeb-5bf0a97d376a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:02.244696 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:02.244660    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:03.009814 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:03.009783    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"
Jul 21 00:49:03.009993 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:03.009821    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm" event={"ID":"cfaa9792-57ca-4b82-bdeb-5bf0a97d376a","Type":"ContainerDied","Data":"32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a"}
Jul 21 00:49:03.009993 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:03.009865    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32febe9a4b9f91a9e1ee55c434e7889305201acacd17ea651284fa42a1cdc98a"
Jul 21 00:49:09.995320 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:09.995286    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:49:09.995753 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:09.995498    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" podUID="5d4c9c43-1a54-4530-ad64-508a2b60803d" containerName="maas-api" containerID="cri-o://0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c" gracePeriod=30
Jul 21 00:49:10.243218 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.243196    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:49:10.315942 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.315878    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca\") pod \"5d4c9c43-1a54-4530-ad64-508a2b60803d\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") "
Jul 21 00:49:10.316110 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.315947    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78xsz\" (UniqueName: \"kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz\") pod \"5d4c9c43-1a54-4530-ad64-508a2b60803d\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") "
Jul 21 00:49:10.316110 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.316002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls\") pod \"5d4c9c43-1a54-4530-ad64-508a2b60803d\" (UID: \"5d4c9c43-1a54-4530-ad64-508a2b60803d\") "
Jul 21 00:49:10.316272 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.316249    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d4c9c43-1a54-4530-ad64-508a2b60803d" (UID: "5d4c9c43-1a54-4530-ad64-508a2b60803d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:10.318067 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.318044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz" (OuterVolumeSpecName: "kube-api-access-78xsz") pod "5d4c9c43-1a54-4530-ad64-508a2b60803d" (UID: "5d4c9c43-1a54-4530-ad64-508a2b60803d"). InnerVolumeSpecName "kube-api-access-78xsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:49:10.318211 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.318195    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d4c9c43-1a54-4530-ad64-508a2b60803d" (UID: "5d4c9c43-1a54-4530-ad64-508a2b60803d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:49:10.416918 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.416893    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4c9c43-1a54-4530-ad64-508a2b60803d-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:10.416918 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.416913    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78xsz\" (UniqueName: \"kubernetes.io/projected/5d4c9c43-1a54-4530-ad64-508a2b60803d-kube-api-access-78xsz\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:10.417048 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:10.416923    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d4c9c43-1a54-4530-ad64-508a2b60803d-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:11.050838 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.050802    2576 generic.go:356] "Generic (PLEG): container finished" podID="5d4c9c43-1a54-4530-ad64-508a2b60803d" containerID="0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c" exitCode=0
Jul 21 00:49:11.051240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.050849    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"
Jul 21 00:49:11.051240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.050897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" event={"ID":"5d4c9c43-1a54-4530-ad64-508a2b60803d","Type":"ContainerDied","Data":"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"}
Jul 21 00:49:11.051240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.050949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr" event={"ID":"5d4c9c43-1a54-4530-ad64-508a2b60803d","Type":"ContainerDied","Data":"247186de3564238fdb89dba4c7a7a8b7763b037d5071338758c1f3e7a48e7bef"}
Jul 21 00:49:11.051240 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.050971    2576 scope.go:117] "RemoveContainer" containerID="0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"
Jul 21 00:49:11.059856 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.059842    2576 scope.go:117] "RemoveContainer" containerID="0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"
Jul 21 00:49:11.060068 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:49:11.060053    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c\": container with ID starting with 0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c not found: ID does not exist" containerID="0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"
Jul 21 00:49:11.060116 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.060074    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c"} err="failed to get container status \"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c\": rpc error: code = NotFound desc = could not find container \"0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c\": container with ID starting with 0b66e2e35e091dba27ab6a73688846b70ec02b3afbd212db1dc731d69bd1bf6c not found: ID does not exist"
Jul 21 00:49:11.071433 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.071288    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:49:11.072841 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:11.072819    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e23578bb-85d98dd6f4-rtrkr"]
Jul 21 00:49:12.078485 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:12.078436    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4c9c43-1a54-4530-ad64-508a2b60803d" path="/var/lib/kubelet/pods/5d4c9c43-1a54-4530-ad64-508a2b60803d/volumes"
Jul 21 00:49:13.186449 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:13.186411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:49:14.514777 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:14.514710    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"]
Jul 21 00:49:14.517184 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:14.517161    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-e23578bb-drmmm"]
Jul 21 00:49:16.078785 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:16.078749    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" path="/var/lib/kubelet/pods/cfaa9792-57ca-4b82-bdeb-5bf0a97d376a/volumes"
Jul 21 00:49:18.906379 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906347    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:18.906778 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906762    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4c9c43-1a54-4530-ad64-508a2b60803d" containerName="maas-api"
Jul 21 00:49:18.906827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906780    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4c9c43-1a54-4530-ad64-508a2b60803d" containerName="maas-api"
Jul 21 00:49:18.906827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906805    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" containerName="revoke-keys"
Jul 21 00:49:18.906827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906811    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" containerName="revoke-keys"
Jul 21 00:49:18.906923 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906863    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfaa9792-57ca-4b82-bdeb-5bf0a97d376a" containerName="revoke-keys"
Jul 21 00:49:18.906923 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.906871    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4c9c43-1a54-4530-ad64-508a2b60803d" containerName="maas-api"
Jul 21 00:49:18.911283 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.911263    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:18.913607 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.913588    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:49:18.914343 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.914317    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e0357210-serving-cert\""
Jul 21 00:49:18.914446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.914318    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:49:18.914446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.914318    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:49:18.920976 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:18.920953    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:19.092999 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.092971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.093143 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.093017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxg7\" (UniqueName: \"kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.093143 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.093082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.194224 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.194199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxg7\" (UniqueName: \"kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.194362 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.194275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.194362 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.194351    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.194965 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.194946    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.196816 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.196791    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.212865 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.212836    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxg7\" (UniqueName: \"kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7\") pod \"maas-api-e2e-derive-e0357210-7fbf994b86-swmb4\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.222724 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.222699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:19.352661 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:19.352639    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:19.354989 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:49:19.354955    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a456fe_b86b_4c23_9158_cc403152c7f5.slice/crio-10182ff39ac55bf4c2cdfcfd8fe97c1d77e6197a899a7b059f211ee1679f4c59 WatchSource:0}: Error finding container 10182ff39ac55bf4c2cdfcfd8fe97c1d77e6197a899a7b059f211ee1679f4c59: Status 404 returned error can't find the container with id 10182ff39ac55bf4c2cdfcfd8fe97c1d77e6197a899a7b059f211ee1679f4c59
Jul 21 00:49:20.090706 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:20.090646    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" event={"ID":"b2a456fe-b86b-4c23-9158-cc403152c7f5","Type":"ContainerStarted","Data":"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"}
Jul 21 00:49:20.091114 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:20.090794    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:20.091114 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:20.090813    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" event={"ID":"b2a456fe-b86b-4c23-9158-cc403152c7f5","Type":"ContainerStarted","Data":"10182ff39ac55bf4c2cdfcfd8fe97c1d77e6197a899a7b059f211ee1679f4c59"}
Jul 21 00:49:20.118655 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:20.118561    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" podStartSLOduration=1.610542447 podStartE2EDuration="2.118543265s" totalImagesPullingTime="508.000818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:49:20.116813369 +0000 UTC m=+1946.474802610" watchObservedRunningTime="2026-07-21 00:49:20.118543265 +0000 UTC m=+1946.476532510"
Jul 21 00:49:24.199244 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:24.199211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:49:26.101060 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:26.101026    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:43.754140 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.754107    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"]
Jul 21 00:49:43.757574 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.757555    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:43.759711 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.759689    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:49:43.763859 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.763835    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"]
Jul 21 00:49:43.781134 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.781106    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0357210-xpkgj\" (UID: \"89def0be-cb9e-4299-baa7-5a3ebbe7b95d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:43.881757 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.881731    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0357210-xpkgj\" (UID: \"89def0be-cb9e-4299-baa7-5a3ebbe7b95d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:43.882361 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:43.882342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-e0357210-xpkgj\" (UID: \"89def0be-cb9e-4299-baa7-5a3ebbe7b95d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:44.069697 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:44.069621    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:44.200374 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:44.200353    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"]
Jul 21 00:49:44.203061 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:49:44.203036    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89def0be_cb9e_4299_baa7_5a3ebbe7b95d.slice/crio-d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e WatchSource:0}: Error finding container d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e: Status 404 returned error can't find the container with id d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e
Jul 21 00:49:45.197955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:45.197924    2576 generic.go:356] "Generic (PLEG): container finished" podID="89def0be-cb9e-4299-baa7-5a3ebbe7b95d" containerID="e9d999ea1771f3c71f030c46cf12e00931b6ca642397488ad51b86e392c640f9" exitCode=0
Jul 21 00:49:45.198312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:45.198006    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj" event={"ID":"89def0be-cb9e-4299-baa7-5a3ebbe7b95d","Type":"ContainerDied","Data":"e9d999ea1771f3c71f030c46cf12e00931b6ca642397488ad51b86e392c640f9"}
Jul 21 00:49:45.198312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:45.198053    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj" event={"ID":"89def0be-cb9e-4299-baa7-5a3ebbe7b95d","Type":"ContainerStarted","Data":"d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e"}
Jul 21 00:49:46.340945 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:46.340919    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:46.404212 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:46.404187    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca\") pod \"89def0be-cb9e-4299-baa7-5a3ebbe7b95d\" (UID: \"89def0be-cb9e-4299-baa7-5a3ebbe7b95d\") "
Jul 21 00:49:46.404499 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:46.404475    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "89def0be-cb9e-4299-baa7-5a3ebbe7b95d" (UID: "89def0be-cb9e-4299-baa7-5a3ebbe7b95d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:46.505361 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:46.505308    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/89def0be-cb9e-4299-baa7-5a3ebbe7b95d-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:47.212917 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:47.212885    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"
Jul 21 00:49:47.213094 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:47.212921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj" event={"ID":"89def0be-cb9e-4299-baa7-5a3ebbe7b95d","Type":"ContainerDied","Data":"d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e"}
Jul 21 00:49:47.213094 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:47.212971    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d54ebf2ccc63091ce7044cef0cf3ebba20d0fb8e11fbe01ad977a2cd17d7054e"
Jul 21 00:49:54.278417 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.278380    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:54.278892 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.278596    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" podUID="b2a456fe-b86b-4c23-9158-cc403152c7f5" containerName="maas-api" containerID="cri-o://cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc" gracePeriod=30
Jul 21 00:49:54.528700 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.528653    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:54.571991 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.571961    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls\") pod \"b2a456fe-b86b-4c23-9158-cc403152c7f5\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") "
Jul 21 00:49:54.572122 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.572014    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlxg7\" (UniqueName: \"kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7\") pod \"b2a456fe-b86b-4c23-9158-cc403152c7f5\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") "
Jul 21 00:49:54.572122 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.572054    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca\") pod \"b2a456fe-b86b-4c23-9158-cc403152c7f5\" (UID: \"b2a456fe-b86b-4c23-9158-cc403152c7f5\") "
Jul 21 00:49:54.572451 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.572429    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b2a456fe-b86b-4c23-9158-cc403152c7f5" (UID: "b2a456fe-b86b-4c23-9158-cc403152c7f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:49:54.574123 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.574098    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b2a456fe-b86b-4c23-9158-cc403152c7f5" (UID: "b2a456fe-b86b-4c23-9158-cc403152c7f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:49:54.574209 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.574129    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7" (OuterVolumeSpecName: "kube-api-access-qlxg7") pod "b2a456fe-b86b-4c23-9158-cc403152c7f5" (UID: "b2a456fe-b86b-4c23-9158-cc403152c7f5"). InnerVolumeSpecName "kube-api-access-qlxg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:49:54.672871 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.672832    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b2a456fe-b86b-4c23-9158-cc403152c7f5-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:54.672871 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.672867    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlxg7\" (UniqueName: \"kubernetes.io/projected/b2a456fe-b86b-4c23-9158-cc403152c7f5-kube-api-access-qlxg7\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:54.672871 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:54.672876    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a456fe-b86b-4c23-9158-cc403152c7f5-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:49:55.247871 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.247832    2576 generic.go:356] "Generic (PLEG): container finished" podID="b2a456fe-b86b-4c23-9158-cc403152c7f5" containerID="cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc" exitCode=0
Jul 21 00:49:55.248039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.247878    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"
Jul 21 00:49:55.248039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.247917    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" event={"ID":"b2a456fe-b86b-4c23-9158-cc403152c7f5","Type":"ContainerDied","Data":"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"}
Jul 21 00:49:55.248039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.247974    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4" event={"ID":"b2a456fe-b86b-4c23-9158-cc403152c7f5","Type":"ContainerDied","Data":"10182ff39ac55bf4c2cdfcfd8fe97c1d77e6197a899a7b059f211ee1679f4c59"}
Jul 21 00:49:55.248039 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.247998    2576 scope.go:117] "RemoveContainer" containerID="cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"
Jul 21 00:49:55.256766 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.256749    2576 scope.go:117] "RemoveContainer" containerID="cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"
Jul 21 00:49:55.257024 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:49:55.257009    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc\": container with ID starting with cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc not found: ID does not exist" containerID="cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"
Jul 21 00:49:55.257074 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.257032    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc"} err="failed to get container status \"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc\": rpc error: code = NotFound desc = could not find container \"cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc\": container with ID starting with cbbbe030627783905b6e388b7aaded5f683e3f6a20949e44b31ffc7814e5cadc not found: ID does not exist"
Jul 21 00:49:55.268082 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.268062    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:55.271879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:55.271859    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e0357210-7fbf994b86-swmb4"]
Jul 21 00:49:56.079141 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:56.079112    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2a456fe-b86b-4c23-9158-cc403152c7f5" path="/var/lib/kubelet/pods/b2a456fe-b86b-4c23-9158-cc403152c7f5/volumes"
Jul 21 00:49:57.191491 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:57.191453    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:49:58.832386 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:58.832347    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"]
Jul 21 00:49:58.834905 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:49:58.834878    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-e0357210-xpkgj"]
Jul 21 00:50:00.079079 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:50:00.079044    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89def0be-cb9e-4299-baa7-5a3ebbe7b95d" path="/var/lib/kubelet/pods/89def0be-cb9e-4299-baa7-5a3ebbe7b95d/volumes"
Jul 21 00:51:24.094627 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:24.094597    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:51:35.050514 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:35.050474    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:51:39.346601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346561    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:51:39.346966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346904    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2a456fe-b86b-4c23-9158-cc403152c7f5" containerName="maas-api"
Jul 21 00:51:39.346966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346916    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2a456fe-b86b-4c23-9158-cc403152c7f5" containerName="maas-api"
Jul 21 00:51:39.346966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346936    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89def0be-cb9e-4299-baa7-5a3ebbe7b95d" containerName="revoke-keys"
Jul 21 00:51:39.346966 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346941    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="89def0be-cb9e-4299-baa7-5a3ebbe7b95d" containerName="revoke-keys"
Jul 21 00:51:39.347093 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.346995    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="89def0be-cb9e-4299-baa7-5a3ebbe7b95d" containerName="revoke-keys"
Jul 21 00:51:39.347093 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.347005    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2a456fe-b86b-4c23-9158-cc403152c7f5" containerName="maas-api"
Jul 21 00:51:39.350208 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.350188    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.352531 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.352506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8c05e2d2-serving-cert\""
Jul 21 00:51:39.352691 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.352625    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:51:39.352865 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.352852    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:51:39.353411 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.353397    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:51:39.359049 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.359027    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:51:39.491748 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.491706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.491748 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.491751    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g7c7\" (UniqueName: \"kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.491985 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.491845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.592303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.592272    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.592476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.592342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.592476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.592365    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g7c7\" (UniqueName: \"kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.592476 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:51:39.592428    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-serving-cert: secret "maas-api-e2e-mt-8c05e2d2-serving-cert" not found
Jul 21 00:51:39.592627 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:51:39.592502    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls podName:baa7e5b7-7847-4099-8a0c-d9ff97efcbab nodeName:}" failed. No retries permitted until 2026-07-21 00:51:40.092484294 +0000 UTC m=+2086.450473512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls") pod "maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" (UID: "baa7e5b7-7847-4099-8a0c-d9ff97efcbab") : secret "maas-api-e2e-mt-8c05e2d2-serving-cert" not found
Jul 21 00:51:39.593084 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.593065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:39.612609 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:39.612540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g7c7\" (UniqueName: \"kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:40.097405 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:40.097368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:40.099937 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:40.099917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") pod \"maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:40.261084 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:40.261046    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:40.411070 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:40.410943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:51:40.413856 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:51:40.413818    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaa7e5b7_7847_4099_8a0c_d9ff97efcbab.slice/crio-5bdd0bfda5512a7a1da92efbcd5f575597fb0ce6966c6570aa0ed7ba062e8d37 WatchSource:0}: Error finding container 5bdd0bfda5512a7a1da92efbcd5f575597fb0ce6966c6570aa0ed7ba062e8d37: Status 404 returned error can't find the container with id 5bdd0bfda5512a7a1da92efbcd5f575597fb0ce6966c6570aa0ed7ba062e8d37
Jul 21 00:51:40.710680 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:40.710623    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" event={"ID":"baa7e5b7-7847-4099-8a0c-d9ff97efcbab","Type":"ContainerStarted","Data":"5bdd0bfda5512a7a1da92efbcd5f575597fb0ce6966c6570aa0ed7ba062e8d37"}
Jul 21 00:51:41.717077 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:41.717043    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" event={"ID":"baa7e5b7-7847-4099-8a0c-d9ff97efcbab","Type":"ContainerStarted","Data":"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"}
Jul 21 00:51:41.717453 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:41.717163    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:41.735875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:41.735825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" podStartSLOduration=2.247169323 podStartE2EDuration="2.735809757s" totalImagesPullingTime="488.640434ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:51:41.734846362 +0000 UTC m=+2088.092835599" watchObservedRunningTime="2026-07-21 00:51:41.735809757 +0000 UTC m=+2088.093798996"
Jul 21 00:51:44.088712 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:44.088658    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:51:47.727419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:47.727387    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:51:51.010363 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.010327    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"]
Jul 21 00:51:51.014829 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.014811    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:51.016991 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.016970    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:51:51.019909 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.019886    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"]
Jul 21 00:51:51.101132 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.101098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb\" (UID: \"ace8623a-e53d-41f2-996c-28c273ac779f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:51.202179 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.202144    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb\" (UID: \"ace8623a-e53d-41f2-996c-28c273ac779f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:51.202851 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.202826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb\" (UID: \"ace8623a-e53d-41f2-996c-28c273ac779f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:51.327483 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.327393    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:51.459228 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.459196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"]
Jul 21 00:51:51.463024 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:51:51.462990    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podace8623a_e53d_41f2_996c_28c273ac779f.slice/crio-218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e WatchSource:0}: Error finding container 218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e: Status 404 returned error can't find the container with id 218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e
Jul 21 00:51:51.766036 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.766004    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb" event={"ID":"ace8623a-e53d-41f2-996c-28c273ac779f","Type":"ContainerStarted","Data":"6736605fc203f8ea7b58820406da9d924c4d51d39087764d3f791bbea5f5129a"}
Jul 21 00:51:51.766165 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.766055    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb" event={"ID":"ace8623a-e53d-41f2-996c-28c273ac779f","Type":"ContainerStarted","Data":"218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e"}
Jul 21 00:51:51.782303 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:51.782260    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb" podStartSLOduration=1.782246306 podStartE2EDuration="1.782246306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:51:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:51:51.781723139 +0000 UTC m=+2098.139712380" watchObservedRunningTime="2026-07-21 00:51:51.782246306 +0000 UTC m=+2098.140235545"
Jul 21 00:51:52.772260 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:52.772223    2576 generic.go:356] "Generic (PLEG): container finished" podID="ace8623a-e53d-41f2-996c-28c273ac779f" containerID="6736605fc203f8ea7b58820406da9d924c4d51d39087764d3f791bbea5f5129a" exitCode=0
Jul 21 00:51:52.772690 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:52.772314    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb" event={"ID":"ace8623a-e53d-41f2-996c-28c273ac779f","Type":"ContainerDied","Data":"6736605fc203f8ea7b58820406da9d924c4d51d39087764d3f791bbea5f5129a"}
Jul 21 00:51:53.912845 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:53.912811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:54.025182 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.025147    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca\") pod \"ace8623a-e53d-41f2-996c-28c273ac779f\" (UID: \"ace8623a-e53d-41f2-996c-28c273ac779f\") "
Jul 21 00:51:54.025503 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.025481    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ace8623a-e53d-41f2-996c-28c273ac779f" (UID: "ace8623a-e53d-41f2-996c-28c273ac779f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:51:54.126555 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.126525    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ace8623a-e53d-41f2-996c-28c273ac779f-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:51:54.151585 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.151554    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:51:54.154777 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.154754    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:51:54.782330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.782291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb" event={"ID":"ace8623a-e53d-41f2-996c-28c273ac779f","Type":"ContainerDied","Data":"218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e"}
Jul 21 00:51:54.782330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.782312    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"
Jul 21 00:51:54.782549 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:51:54.782369    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="218742973d48dba2c27acf8f17f3e52cea5e96df75b511d11bd9ff70e39a070e"
Jul 21 00:52:01.449872 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.449829    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:52:01.450369 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.450133    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" podUID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" containerName="maas-api" containerID="cri-o://141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a" gracePeriod=30
Jul 21 00:52:01.704828 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.704769    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:52:01.813286 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.813249    2576 generic.go:356] "Generic (PLEG): container finished" podID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" containerID="141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a" exitCode=0
Jul 21 00:52:01.813476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.813301    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"
Jul 21 00:52:01.813476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.813336    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" event={"ID":"baa7e5b7-7847-4099-8a0c-d9ff97efcbab","Type":"ContainerDied","Data":"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"}
Jul 21 00:52:01.813476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.813414    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8" event={"ID":"baa7e5b7-7847-4099-8a0c-d9ff97efcbab","Type":"ContainerDied","Data":"5bdd0bfda5512a7a1da92efbcd5f575597fb0ce6966c6570aa0ed7ba062e8d37"}
Jul 21 00:52:01.813476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.813438    2576 scope.go:117] "RemoveContainer" containerID="141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"
Jul 21 00:52:01.821631 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.821621    2576 scope.go:117] "RemoveContainer" containerID="141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"
Jul 21 00:52:01.821930 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:52:01.821900    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a\": container with ID starting with 141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a not found: ID does not exist" containerID="141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"
Jul 21 00:52:01.821987 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.821937    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a"} err="failed to get container status \"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a\": rpc error: code = NotFound desc = could not find container \"141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a\": container with ID starting with 141bbe31866be67fc6c0919a2b58e771d81e16c4292e4930b9fe10bf700a764a not found: ID does not exist"
Jul 21 00:52:01.893377 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.893340    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5g7c7\" (UniqueName: \"kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7\") pod \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") "
Jul 21 00:52:01.893556 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.893429    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca\") pod \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") "
Jul 21 00:52:01.893556 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.893469    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") pod \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\" (UID: \"baa7e5b7-7847-4099-8a0c-d9ff97efcbab\") "
Jul 21 00:52:01.893789 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.893763    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "baa7e5b7-7847-4099-8a0c-d9ff97efcbab" (UID: "baa7e5b7-7847-4099-8a0c-d9ff97efcbab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:52:01.895645 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.895622    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "baa7e5b7-7847-4099-8a0c-d9ff97efcbab" (UID: "baa7e5b7-7847-4099-8a0c-d9ff97efcbab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:52:01.895759 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.895694    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7" (OuterVolumeSpecName: "kube-api-access-5g7c7") pod "baa7e5b7-7847-4099-8a0c-d9ff97efcbab" (UID: "baa7e5b7-7847-4099-8a0c-d9ff97efcbab"). InnerVolumeSpecName "kube-api-access-5g7c7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:52:01.994455 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.994359    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5g7c7\" (UniqueName: \"kubernetes.io/projected/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-kube-api-access-5g7c7\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:52:01.994455 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.994405    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:52:01.994455 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:01.994416    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/baa7e5b7-7847-4099-8a0c-d9ff97efcbab-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:52:02.129694 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:02.129636    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:52:02.131551 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:02.131527    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8c05e2d2-845c4c5cb6-7vtc8"]
Jul 21 00:52:04.079758 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:04.079723    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" path="/var/lib/kubelet/pods/baa7e5b7-7847-4099-8a0c-d9ff97efcbab/volumes"
Jul 21 00:52:04.390926 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:04.390837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:52:06.089606 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:06.089571    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"]
Jul 21 00:52:06.092279 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:06.092255    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8c05e2d2-hsppb"]
Jul 21 00:52:08.079556 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:08.079513    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ace8623a-e53d-41f2-996c-28c273ac779f" path="/var/lib/kubelet/pods/ace8623a-e53d-41f2-996c-28c273ac779f/volumes"
Jul 21 00:52:35.748985 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.748952    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:52:35.749446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749421    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" containerName="maas-api"
Jul 21 00:52:35.749446 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749439    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" containerName="maas-api"
Jul 21 00:52:35.749561 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749462    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ace8623a-e53d-41f2-996c-28c273ac779f" containerName="revoke-keys"
Jul 21 00:52:35.749561 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749472    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ace8623a-e53d-41f2-996c-28c273ac779f" containerName="revoke-keys"
Jul 21 00:52:35.749681 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749604    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="baa7e5b7-7847-4099-8a0c-d9ff97efcbab" containerName="maas-api"
Jul 21 00:52:35.749681 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.749622    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ace8623a-e53d-41f2-996c-28c273ac779f" containerName="revoke-keys"
Jul 21 00:52:35.752876 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.752852    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.755246 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.755218    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c6467f0b-serving-cert\""
Jul 21 00:52:35.755246 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.755233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:52:35.755430 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.755223    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:52:35.755430 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.755233    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:52:35.763904 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.763881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:52:35.878594 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.878554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.878789 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.878706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q646g\" (UniqueName: \"kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.878789 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.878746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.979826 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.979780    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q646g\" (UniqueName: \"kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.979826 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.979833    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.980090 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.979867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.980464 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.980445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.982455 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.982434    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:35.990195 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:35.990172    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q646g\" (UniqueName: \"kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g\") pod \"maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:36.064795 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.064701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:36.196913 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.196881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:52:36.200367 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:52:36.200342    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fd7dc4_eadf_4473_b695_bc54b82d1033.slice/crio-1d57208672fc37104db81300f34c7004892d6e5d658df8b4a438c7b850ca4bbf WatchSource:0}: Error finding container 1d57208672fc37104db81300f34c7004892d6e5d658df8b4a438c7b850ca4bbf: Status 404 returned error can't find the container with id 1d57208672fc37104db81300f34c7004892d6e5d658df8b4a438c7b850ca4bbf
Jul 21 00:52:36.201723 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.201701    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:52:36.968509 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.968476    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" event={"ID":"84fd7dc4-eadf-4473-b695-bc54b82d1033","Type":"ContainerStarted","Data":"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"}
Jul 21 00:52:36.969014 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.968525    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" event={"ID":"84fd7dc4-eadf-4473-b695-bc54b82d1033","Type":"ContainerStarted","Data":"1d57208672fc37104db81300f34c7004892d6e5d658df8b4a438c7b850ca4bbf"}
Jul 21 00:52:36.969014 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.968615    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:36.986899 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:36.986853    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" podStartSLOduration=1.539754844 podStartE2EDuration="1.986839351s" totalImagesPullingTime="447.084507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:52:36.985549547 +0000 UTC m=+2143.343538788" watchObservedRunningTime="2026-07-21 00:52:36.986839351 +0000 UTC m=+2143.344828591"
Jul 21 00:52:40.196544 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:40.196505    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:52:42.978449 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:42.978413    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:52:51.698080 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:52:51.698048    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:53:05.597213 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:05.597177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:53:09.178784 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.178747    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"]
Jul 21 00:53:09.182044 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.182020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:09.184118 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.184088    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:53:09.192523 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.192499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"]
Jul 21 00:53:09.276608 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.276570    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49\" (UID: \"581fcba5-d46a-4191-823d-bf1ebe7df6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:09.377654 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.377608    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49\" (UID: \"581fcba5-d46a-4191-823d-bf1ebe7df6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:09.378278 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.378258    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49\" (UID: \"581fcba5-d46a-4191-823d-bf1ebe7df6f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:09.493017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.492976    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:09.619862 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:09.619806    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"]
Jul 21 00:53:09.622582 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:53:09.622556    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581fcba5_d46a_4191_823d_bf1ebe7df6f6.slice/crio-1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61 WatchSource:0}: Error finding container 1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61: Status 404 returned error can't find the container with id 1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61
Jul 21 00:53:10.115215 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:10.115126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49" event={"ID":"581fcba5-d46a-4191-823d-bf1ebe7df6f6","Type":"ContainerStarted","Data":"9c69bfd11240b176aed9ca217d0acddf760264fceb46ce2123857992bb06b534"}
Jul 21 00:53:10.115215 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:10.115184    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49" event={"ID":"581fcba5-d46a-4191-823d-bf1ebe7df6f6","Type":"ContainerStarted","Data":"1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61"}
Jul 21 00:53:10.130146 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:10.130100    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49" podStartSLOduration=1.130084617 podStartE2EDuration="1.130084617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:53:10.129060622 +0000 UTC m=+2176.487049863" watchObservedRunningTime="2026-07-21 00:53:10.130084617 +0000 UTC m=+2176.488073835"
Jul 21 00:53:11.122085 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:11.122050    2576 generic.go:356] "Generic (PLEG): container finished" podID="581fcba5-d46a-4191-823d-bf1ebe7df6f6" containerID="9c69bfd11240b176aed9ca217d0acddf760264fceb46ce2123857992bb06b534" exitCode=0
Jul 21 00:53:11.122566 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:11.122093    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49" event={"ID":"581fcba5-d46a-4191-823d-bf1ebe7df6f6","Type":"ContainerDied","Data":"9c69bfd11240b176aed9ca217d0acddf760264fceb46ce2123857992bb06b534"}
Jul 21 00:53:12.256659 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:12.256630    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:12.306609 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:12.306573    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca\") pod \"581fcba5-d46a-4191-823d-bf1ebe7df6f6\" (UID: \"581fcba5-d46a-4191-823d-bf1ebe7df6f6\") "
Jul 21 00:53:12.306969 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:12.306944    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "581fcba5-d46a-4191-823d-bf1ebe7df6f6" (UID: "581fcba5-d46a-4191-823d-bf1ebe7df6f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:53:12.407299 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:12.407204    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/581fcba5-d46a-4191-823d-bf1ebe7df6f6-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:53:13.132701 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:13.132654    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"
Jul 21 00:53:13.132861 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:13.132647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49" event={"ID":"581fcba5-d46a-4191-823d-bf1ebe7df6f6","Type":"ContainerDied","Data":"1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61"}
Jul 21 00:53:13.132861 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:13.132805    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cdd79f94d633dcac48361d29242bab3af60c2e44566749f857913422cfd7b61"
Jul 21 00:53:23.191973 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:23.191931    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:53:24.696315 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:24.696284    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:53:24.696729 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:24.696504    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" podUID="84fd7dc4-eadf-4473-b695-bc54b82d1033" containerName="maas-api" containerID="cri-o://d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493" gracePeriod=30
Jul 21 00:53:24.946715 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:24.946643    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:53:25.023363 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.023319    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls\") pod \"84fd7dc4-eadf-4473-b695-bc54b82d1033\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") "
Jul 21 00:53:25.023548 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.023377    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca\") pod \"84fd7dc4-eadf-4473-b695-bc54b82d1033\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") "
Jul 21 00:53:25.023548 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.023394    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q646g\" (UniqueName: \"kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g\") pod \"84fd7dc4-eadf-4473-b695-bc54b82d1033\" (UID: \"84fd7dc4-eadf-4473-b695-bc54b82d1033\") "
Jul 21 00:53:25.023801 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.023771    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84fd7dc4-eadf-4473-b695-bc54b82d1033" (UID: "84fd7dc4-eadf-4473-b695-bc54b82d1033"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:53:25.025661 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.025638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g" (OuterVolumeSpecName: "kube-api-access-q646g") pod "84fd7dc4-eadf-4473-b695-bc54b82d1033" (UID: "84fd7dc4-eadf-4473-b695-bc54b82d1033"). InnerVolumeSpecName "kube-api-access-q646g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:53:25.025759 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.025696    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84fd7dc4-eadf-4473-b695-bc54b82d1033" (UID: "84fd7dc4-eadf-4473-b695-bc54b82d1033"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:53:25.124827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.124786    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84fd7dc4-eadf-4473-b695-bc54b82d1033-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:53:25.124827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.124819    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q646g\" (UniqueName: \"kubernetes.io/projected/84fd7dc4-eadf-4473-b695-bc54b82d1033-kube-api-access-q646g\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:53:25.124827 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.124830    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84fd7dc4-eadf-4473-b695-bc54b82d1033-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:53:25.185564 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.185524    2576 generic.go:356] "Generic (PLEG): container finished" podID="84fd7dc4-eadf-4473-b695-bc54b82d1033" containerID="d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493" exitCode=0
Jul 21 00:53:25.185774 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.185581    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"
Jul 21 00:53:25.185774 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.185614    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" event={"ID":"84fd7dc4-eadf-4473-b695-bc54b82d1033","Type":"ContainerDied","Data":"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"}
Jul 21 00:53:25.185774 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.185716    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l" event={"ID":"84fd7dc4-eadf-4473-b695-bc54b82d1033","Type":"ContainerDied","Data":"1d57208672fc37104db81300f34c7004892d6e5d658df8b4a438c7b850ca4bbf"}
Jul 21 00:53:25.185774 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.185749    2576 scope.go:117] "RemoveContainer" containerID="d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"
Jul 21 00:53:25.194192 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.194165    2576 scope.go:117] "RemoveContainer" containerID="d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"
Jul 21 00:53:25.194440 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:53:25.194423    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493\": container with ID starting with d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493 not found: ID does not exist" containerID="d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"
Jul 21 00:53:25.194497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.194448    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493"} err="failed to get container status \"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493\": rpc error: code = NotFound desc = could not find container \"d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493\": container with ID starting with d9a8af732032068bcc1c8ff02b8ba8dead38f4139e021f586837f75c0fdc8493 not found: ID does not exist"
Jul 21 00:53:25.206094 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.206039    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:53:25.209410 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:25.209386    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c6467f0b-7f56c8b49-ckk9l"]
Jul 21 00:53:26.080438 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:26.080396    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84fd7dc4-eadf-4473-b695-bc54b82d1033" path="/var/lib/kubelet/pods/84fd7dc4-eadf-4473-b695-bc54b82d1033/volumes"
Jul 21 00:53:29.307166 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:29.307134    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"]
Jul 21 00:53:29.309918 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:29.309879    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c6467f0b-lbx49"]
Jul 21 00:53:30.079334 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:30.079303    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581fcba5-d46a-4191-823d-bf1ebe7df6f6" path="/var/lib/kubelet/pods/581fcba5-d46a-4191-823d-bf1ebe7df6f6/volumes"
Jul 21 00:53:31.486208 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:53:31.486170    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:54:24.201064 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:54:24.201025    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:54:34.498923 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:54:34.498889    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:54:54.196447 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:54:54.196411    2576 scope.go:117] "RemoveContainer" containerID="ade156b855e4323e131c2f429174491010341968729cb2cbe7101209b049c799"
Jul 21 00:55:19.794436 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.794397    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:55:19.794940 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.794920    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84fd7dc4-eadf-4473-b695-bc54b82d1033" containerName="maas-api"
Jul 21 00:55:19.794940 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.794937    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84fd7dc4-eadf-4473-b695-bc54b82d1033" containerName="maas-api"
Jul 21 00:55:19.795025 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.794959    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581fcba5-d46a-4191-823d-bf1ebe7df6f6" containerName="revoke-keys"
Jul 21 00:55:19.795025 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.794966    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="581fcba5-d46a-4191-823d-bf1ebe7df6f6" containerName="revoke-keys"
Jul 21 00:55:19.795025 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.795013    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84fd7dc4-eadf-4473-b695-bc54b82d1033" containerName="maas-api"
Jul 21 00:55:19.795025 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.795024    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="581fcba5-d46a-4191-823d-bf1ebe7df6f6" containerName="revoke-keys"
Jul 21 00:55:19.797957 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.797941    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.800330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.800311    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:55:19.800808 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.800788    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:55:19.801030 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.801014    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-1c3d09-serving-cert\""
Jul 21 00:55:19.801078 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.801022    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:55:19.807875 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.807846    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:55:19.876781 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.876741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.876961 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.876827    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z24h8\" (UniqueName: \"kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.876961 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.876884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.977991 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.977956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z24h8\" (UniqueName: \"kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.978203 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.978012    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.978277 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.978193    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.978866 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.978793    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.980683 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.980644    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:19.989078 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:19.989058    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z24h8\" (UniqueName: \"kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8\") pod \"maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:20.110701 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:20.110589    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:20.248104 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:20.248045    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:55:20.250840 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:55:20.250811    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76dd1feb_8ffc_4394_9a99_74a0ffbbee29.slice/crio-25d0be1465828caeea89c68a832c313431d0e9104f5ad05da7d451c49f274dc9 WatchSource:0}: Error finding container 25d0be1465828caeea89c68a832c313431d0e9104f5ad05da7d451c49f274dc9: Status 404 returned error can't find the container with id 25d0be1465828caeea89c68a832c313431d0e9104f5ad05da7d451c49f274dc9
Jul 21 00:55:20.702942 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:20.702905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" event={"ID":"76dd1feb-8ffc-4394-9a99-74a0ffbbee29","Type":"ContainerStarted","Data":"25d0be1465828caeea89c68a832c313431d0e9104f5ad05da7d451c49f274dc9"}
Jul 21 00:55:21.708656 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:21.708616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" event={"ID":"76dd1feb-8ffc-4394-9a99-74a0ffbbee29","Type":"ContainerStarted","Data":"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"}
Jul 21 00:55:21.709004 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:21.708714    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:21.725758 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:21.725709    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" podStartSLOduration=2.301831563 podStartE2EDuration="2.72569653s" totalImagesPullingTime="423.864967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:55:21.723944474 +0000 UTC m=+2308.081933727" watchObservedRunningTime="2026-07-21 00:55:21.72569653 +0000 UTC m=+2308.083685767"
Jul 21 00:55:25.202154 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:25.202122    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:55:27.718380 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.718351    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:55:27.886828 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.886789    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:55:27.891319 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.891297    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:27.894098 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.894073    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ee9ef4-serving-cert\""
Jul 21 00:55:27.901140 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.901118    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:55:27.943445 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.943407    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:27.943605 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.943455    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:27.943605 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:27.943502    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg6nc\" (UniqueName: \"kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.044176 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.044092    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.044176 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.044142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.044375 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:55:28.044242    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-serving-cert: secret "maas-api-e2e-inf-b-ee9ef4-serving-cert" not found
Jul 21 00:55:28.044375 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.044276    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg6nc\" (UniqueName: \"kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.044375 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:55:28.044303    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls podName:fbcb7046-580c-4565-ae2f-a5e059d3dec9 nodeName:}" failed. No retries permitted until 2026-07-21 00:55:28.544283675 +0000 UTC m=+2314.902272893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls") pod "maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" (UID: "fbcb7046-580c-4565-ae2f-a5e059d3dec9") : secret "maas-api-e2e-inf-b-ee9ef4-serving-cert" not found
Jul 21 00:55:28.046290 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.046272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.052348 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.052323    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg6nc\" (UniqueName: \"kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.549097 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.549055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.551720 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.551697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") pod \"maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.803836 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.803749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:28.937996 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:28.937966    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:55:28.940561 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:55:28.940531    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbcb7046_580c_4565_ae2f_a5e059d3dec9.slice/crio-e49262d07c18965c2bc10c4dcd4f35bcfb850b636e5e5d713c9b2b229944ad54 WatchSource:0}: Error finding container e49262d07c18965c2bc10c4dcd4f35bcfb850b636e5e5d713c9b2b229944ad54: Status 404 returned error can't find the container with id e49262d07c18965c2bc10c4dcd4f35bcfb850b636e5e5d713c9b2b229944ad54
Jul 21 00:55:29.744300 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:29.744264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" event={"ID":"fbcb7046-580c-4565-ae2f-a5e059d3dec9","Type":"ContainerStarted","Data":"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"}
Jul 21 00:55:29.744488 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:29.744318    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" event={"ID":"fbcb7046-580c-4565-ae2f-a5e059d3dec9","Type":"ContainerStarted","Data":"e49262d07c18965c2bc10c4dcd4f35bcfb850b636e5e5d713c9b2b229944ad54"}
Jul 21 00:55:29.744488 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:29.744382    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:29.761312 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:29.761259    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" podStartSLOduration=2.340555948 podStartE2EDuration="2.761241607s" totalImagesPullingTime="420.685659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:55:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:55:29.759456566 +0000 UTC m=+2316.117445808" watchObservedRunningTime="2026-07-21 00:55:29.761241607 +0000 UTC m=+2316.119230846"
Jul 21 00:55:35.755106 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:35.755072    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:55:37.093370 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:37.093336    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:55:48.303765 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:48.303730    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:55:54.214141 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:54.214107    2576 scope.go:117] "RemoveContainer" containerID="e9d999ea1771f3c71f030c46cf12e00931b6ca642397488ad51b86e392c640f9"
Jul 21 00:55:54.222057 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:55:54.222022    2576 scope.go:117] "RemoveContainer" containerID="e5cab2611297fbe2292b1f485ecc3cec62872f43672c3a380432f5eb5b91aeea"
Jul 21 00:56:03.690688 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:03.690633    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:56:38.024630 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.024594    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"]
Jul 21 00:56:38.027924 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.027907    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:38.030170 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.030152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:56:38.034399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.034367    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"]
Jul 21 00:56:38.147227 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.147195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz\" (UID: \"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:38.248411 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.248379    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz\" (UID: \"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:38.249014 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.248994    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz\" (UID: \"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:38.339547 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.339473    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:38.469947 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:38.469923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"]
Jul 21 00:56:38.471914 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:56:38.471879    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07ac7c5_ec07_4aa8_b01c_ccf3a503c331.slice/crio-3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa WatchSource:0}: Error finding container 3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa: Status 404 returned error can't find the container with id 3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa
Jul 21 00:56:39.059306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:39.059213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz" event={"ID":"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331","Type":"ContainerStarted","Data":"26e311aacc75e86f63f81b8819cda38f4b2e997abeb7f2e246a39192d7364747"}
Jul 21 00:56:39.059306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:39.059265    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz" event={"ID":"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331","Type":"ContainerStarted","Data":"3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa"}
Jul 21 00:56:39.074452 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:39.074402    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz" podStartSLOduration=1.074388204 podStartE2EDuration="1.074388204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:56:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:56:39.073468844 +0000 UTC m=+2385.431458085" watchObservedRunningTime="2026-07-21 00:56:39.074388204 +0000 UTC m=+2385.432377444"
Jul 21 00:56:40.064534 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:40.064497    2576 generic.go:356] "Generic (PLEG): container finished" podID="b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" containerID="26e311aacc75e86f63f81b8819cda38f4b2e997abeb7f2e246a39192d7364747" exitCode=0
Jul 21 00:56:40.064916 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:40.064587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz" event={"ID":"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331","Type":"ContainerDied","Data":"26e311aacc75e86f63f81b8819cda38f4b2e997abeb7f2e246a39192d7364747"}
Jul 21 00:56:41.188451 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:41.188426    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:41.377653 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:41.377570    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca\") pod \"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331\" (UID: \"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331\") "
Jul 21 00:56:41.377957 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:41.377932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" (UID: "b07ac7c5-ec07-4aa8-b01c-ccf3a503c331"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:56:41.478153 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:41.478117    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:56:41.997346 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:41.997313    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:56:42.075497 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:42.075469    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"
Jul 21 00:56:42.080204 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:42.080169    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz" event={"ID":"b07ac7c5-ec07-4aa8-b01c-ccf3a503c331","Type":"ContainerDied","Data":"3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa"}
Jul 21 00:56:42.080330 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:42.080228    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c281660acf222f9c6b10fdc8dff5611c611e0c2be444cd2aa3a8b6dabef17fa"
Jul 21 00:56:48.504646 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:48.504612    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:56:48.505121 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:48.504888    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" podUID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" containerName="maas-api" containerID="cri-o://b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8" gracePeriod=30
Jul 21 00:56:48.955601 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:48.955575    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:56:49.044560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.044481    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca\") pod \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") "
Jul 21 00:56:49.044560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.044550    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z24h8\" (UniqueName: \"kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8\") pod \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") "
Jul 21 00:56:49.044826 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.044585    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls\") pod \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\" (UID: \"76dd1feb-8ffc-4394-9a99-74a0ffbbee29\") "
Jul 21 00:56:49.044975 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.044932    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76dd1feb-8ffc-4394-9a99-74a0ffbbee29" (UID: "76dd1feb-8ffc-4394-9a99-74a0ffbbee29"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:56:49.046853 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.046831    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76dd1feb-8ffc-4394-9a99-74a0ffbbee29" (UID: "76dd1feb-8ffc-4394-9a99-74a0ffbbee29"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:56:49.046935 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.046914    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8" (OuterVolumeSpecName: "kube-api-access-z24h8") pod "76dd1feb-8ffc-4394-9a99-74a0ffbbee29" (UID: "76dd1feb-8ffc-4394-9a99-74a0ffbbee29"). InnerVolumeSpecName "kube-api-access-z24h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:56:49.106867 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.106834    2576 generic.go:356] "Generic (PLEG): container finished" podID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" containerID="b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8" exitCode=0
Jul 21 00:56:49.107016 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.106878    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"
Jul 21 00:56:49.107016 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.106925    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" event={"ID":"76dd1feb-8ffc-4394-9a99-74a0ffbbee29","Type":"ContainerDied","Data":"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"}
Jul 21 00:56:49.107016 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.106985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms" event={"ID":"76dd1feb-8ffc-4394-9a99-74a0ffbbee29","Type":"ContainerDied","Data":"25d0be1465828caeea89c68a832c313431d0e9104f5ad05da7d451c49f274dc9"}
Jul 21 00:56:49.107016 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.107009    2576 scope.go:117] "RemoveContainer" containerID="b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"
Jul 21 00:56:49.116243 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.116222    2576 scope.go:117] "RemoveContainer" containerID="b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"
Jul 21 00:56:49.116508 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:56:49.116487    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8\": container with ID starting with b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8 not found: ID does not exist" containerID="b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"
Jul 21 00:56:49.116587 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.116520    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8"} err="failed to get container status \"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8\": rpc error: code = NotFound desc = could not find container \"b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8\": container with ID starting with b425f4a098f1609b1cf2ed0d736ecf274702862b8e20e3eeeb5cc068420f4da8 not found: ID does not exist"
Jul 21 00:56:49.129142 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.129120    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:56:49.136339 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.136316    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1c3d09-6fb98bc75f-wcwms"]
Jul 21 00:56:49.145373 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.145351    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:56:49.145373 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.145370    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z24h8\" (UniqueName: \"kubernetes.io/projected/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-kube-api-access-z24h8\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:56:49.145490 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:49.145380    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76dd1feb-8ffc-4394-9a99-74a0ffbbee29-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:56:50.079465 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:50.079432    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" path="/var/lib/kubelet/pods/76dd1feb-8ffc-4394-9a99-74a0ffbbee29/volumes"
Jul 21 00:56:53.128180 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:53.128149    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"]
Jul 21 00:56:53.131043 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:53.131021    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1c3d09-pwzcz"]
Jul 21 00:56:54.079709 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:54.079656    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" path="/var/lib/kubelet/pods/b07ac7c5-ec07-4aa8-b01c-ccf3a503c331/volumes"
Jul 21 00:56:54.177724 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:54.177695    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:56:54.184392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:54.184367    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 00:56:57.126185 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:56:57.126150    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:57:00.341020 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.340983    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"]
Jul 21 00:57:00.341399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341304    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" containerName="maas-api"
Jul 21 00:57:00.341399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341315    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" containerName="maas-api"
Jul 21 00:57:00.341399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341323    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" containerName="revoke-keys"
Jul 21 00:57:00.341399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341328    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" containerName="revoke-keys"
Jul 21 00:57:00.341399 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341395    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b07ac7c5-ec07-4aa8-b01c-ccf3a503c331" containerName="revoke-keys"
Jul 21 00:57:00.341599 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.341403    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="76dd1feb-8ffc-4394-9a99-74a0ffbbee29" containerName="maas-api"
Jul 21 00:57:00.344336 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.344320    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:00.347277 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.347254    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:57:00.357826 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.357799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"]
Jul 21 00:57:00.438524 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.438493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48\" (UID: \"59df0803-b14c-4905-8fb5-66890800f5b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:00.539879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.539837    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48\" (UID: \"59df0803-b14c-4905-8fb5-66890800f5b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:00.540462 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.540440    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48\" (UID: \"59df0803-b14c-4905-8fb5-66890800f5b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:00.654154 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.654068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:00.788201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:00.788177    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"]
Jul 21 00:57:00.790334 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:57:00.790306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59df0803_b14c_4905_8fb5_66890800f5b7.slice/crio-2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15 WatchSource:0}: Error finding container 2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15: Status 404 returned error can't find the container with id 2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15
Jul 21 00:57:01.160244 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:01.160205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48" event={"ID":"59df0803-b14c-4905-8fb5-66890800f5b7","Type":"ContainerStarted","Data":"56f213b4edb04c183bfb91d24f8926d0f9ce6d12fb5ab09db6512e97bc87253a"}
Jul 21 00:57:01.160434 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:01.160263    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48" event={"ID":"59df0803-b14c-4905-8fb5-66890800f5b7","Type":"ContainerStarted","Data":"2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15"}
Jul 21 00:57:01.174690 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:01.174602    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48" podStartSLOduration=1.1745881200000001 podStartE2EDuration="1.17458812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:57:01.173505477 +0000 UTC m=+2407.531494720" watchObservedRunningTime="2026-07-21 00:57:01.17458812 +0000 UTC m=+2407.532577359"
Jul 21 00:57:02.166925 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:02.166892    2576 generic.go:356] "Generic (PLEG): container finished" podID="59df0803-b14c-4905-8fb5-66890800f5b7" containerID="56f213b4edb04c183bfb91d24f8926d0f9ce6d12fb5ab09db6512e97bc87253a" exitCode=0
Jul 21 00:57:02.167289 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:02.166969    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48" event={"ID":"59df0803-b14c-4905-8fb5-66890800f5b7","Type":"ContainerDied","Data":"56f213b4edb04c183bfb91d24f8926d0f9ce6d12fb5ab09db6512e97bc87253a"}
Jul 21 00:57:03.307826 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:03.307800    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:03.368387 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:03.368296    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca\") pod \"59df0803-b14c-4905-8fb5-66890800f5b7\" (UID: \"59df0803-b14c-4905-8fb5-66890800f5b7\") "
Jul 21 00:57:03.368643 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:03.368619    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "59df0803-b14c-4905-8fb5-66890800f5b7" (UID: "59df0803-b14c-4905-8fb5-66890800f5b7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:57:03.469447 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:03.469414    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/59df0803-b14c-4905-8fb5-66890800f5b7-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:57:04.177592 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:04.177558    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"
Jul 21 00:57:04.177777 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:04.177557    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48" event={"ID":"59df0803-b14c-4905-8fb5-66890800f5b7","Type":"ContainerDied","Data":"2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15"}
Jul 21 00:57:04.177777 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:04.177698    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2060b2cd3ea5252fd5cf6ecb6eb4ec633edd4d677c2fbf892a5f61375064ec15"
Jul 21 00:57:10.758842 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:10.758799    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:57:10.759397 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:10.759045    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" podUID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" containerName="maas-api" containerID="cri-o://5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f" gracePeriod=30
Jul 21 00:57:11.006110 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.006083    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:57:11.130772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.130656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wg6nc\" (UniqueName: \"kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc\") pod \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") "
Jul 21 00:57:11.130772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.130759    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca\") pod \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") "
Jul 21 00:57:11.130959 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.130786    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") pod \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\" (UID: \"fbcb7046-580c-4565-ae2f-a5e059d3dec9\") "
Jul 21 00:57:11.131137 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.131096    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbcb7046-580c-4565-ae2f-a5e059d3dec9" (UID: "fbcb7046-580c-4565-ae2f-a5e059d3dec9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:57:11.132927 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.132904    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc" (OuterVolumeSpecName: "kube-api-access-wg6nc") pod "fbcb7046-580c-4565-ae2f-a5e059d3dec9" (UID: "fbcb7046-580c-4565-ae2f-a5e059d3dec9"). InnerVolumeSpecName "kube-api-access-wg6nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:57:11.133011 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.132955    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbcb7046-580c-4565-ae2f-a5e059d3dec9" (UID: "fbcb7046-580c-4565-ae2f-a5e059d3dec9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:57:11.209096 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.209053    2576 generic.go:356] "Generic (PLEG): container finished" podID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" containerID="5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f" exitCode=0
Jul 21 00:57:11.209261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.209102    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"
Jul 21 00:57:11.209261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.209142    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" event={"ID":"fbcb7046-580c-4565-ae2f-a5e059d3dec9","Type":"ContainerDied","Data":"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"}
Jul 21 00:57:11.209261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.209188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m" event={"ID":"fbcb7046-580c-4565-ae2f-a5e059d3dec9","Type":"ContainerDied","Data":"e49262d07c18965c2bc10c4dcd4f35bcfb850b636e5e5d713c9b2b229944ad54"}
Jul 21 00:57:11.209261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.209210    2576 scope.go:117] "RemoveContainer" containerID="5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"
Jul 21 00:57:11.218254 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.218236    2576 scope.go:117] "RemoveContainer" containerID="5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"
Jul 21 00:57:11.218522 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:57:11.218502    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f\": container with ID starting with 5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f not found: ID does not exist" containerID="5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"
Jul 21 00:57:11.218572 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.218532    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f"} err="failed to get container status \"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f\": rpc error: code = NotFound desc = could not find container \"5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f\": container with ID starting with 5a34bf0d6a8ccfee9fa0d0d634b7a54c72efdb819fba67e4f8ea7132b1f09a4f not found: ID does not exist"
Jul 21 00:57:11.228433 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.228409    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:57:11.230571 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.230548    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ee9ef4-5ccc6746f4-jqm4m"]
Jul 21 00:57:11.232219 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.232200    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wg6nc\" (UniqueName: \"kubernetes.io/projected/fbcb7046-580c-4565-ae2f-a5e059d3dec9-kube-api-access-wg6nc\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:57:11.232276 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.232222    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbcb7046-580c-4565-ae2f-a5e059d3dec9-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:57:11.232276 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:11.232233    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbcb7046-580c-4565-ae2f-a5e059d3dec9-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:57:12.079734 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:12.079693    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" path="/var/lib/kubelet/pods/fbcb7046-580c-4565-ae2f-a5e059d3dec9/volumes"
Jul 21 00:57:12.689175 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:12.689129    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:57:15.411642 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:15.411532    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"]
Jul 21 00:57:15.413143 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:15.413115    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee9ef4-96w48"]
Jul 21 00:57:16.079750 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:16.079717    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59df0803-b14c-4905-8fb5-66890800f5b7" path="/var/lib/kubelet/pods/59df0803-b14c-4905-8fb5-66890800f5b7/volumes"
Jul 21 00:57:26.456202 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456161    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:57:26.456635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456530    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" containerName="maas-api"
Jul 21 00:57:26.456635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456543    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" containerName="maas-api"
Jul 21 00:57:26.456635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456557    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59df0803-b14c-4905-8fb5-66890800f5b7" containerName="revoke-keys"
Jul 21 00:57:26.456635 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456562    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59df0803-b14c-4905-8fb5-66890800f5b7" containerName="revoke-keys"
Jul 21 00:57:26.456787 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456642    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="59df0803-b14c-4905-8fb5-66890800f5b7" containerName="revoke-keys"
Jul 21 00:57:26.456787 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.456650    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbcb7046-580c-4565-ae2f-a5e059d3dec9" containerName="maas-api"
Jul 21 00:57:26.461149 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.461129    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.464923 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.464900    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:57:26.465326 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.465305    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:57:26.465440 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.465353    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e541cf-serving-cert\""
Jul 21 00:57:26.466226 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.466211    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:57:26.480772 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.480746    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:57:26.571937 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.571908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.572097 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.571963    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.572097 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.572032    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-676ng\" (UniqueName: \"kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.672816 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.672781    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-676ng\" (UniqueName: \"kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.672983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.672829    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.672983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.672880    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.673965 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.673937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.675435 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.675413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.681485 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.681460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-676ng\" (UniqueName: \"kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng\") pod \"maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.772138 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.772044    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:26.927255 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:57:26.927224    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b6a6a0b_a395_4720_8e0c_1890c44ce480.slice/crio-6524f3c61d06c21180e1df3d6814bb3b76b2cd330d0a7729ae55b36f4d24e04d WatchSource:0}: Error finding container 6524f3c61d06c21180e1df3d6814bb3b76b2cd330d0a7729ae55b36f4d24e04d: Status 404 returned error can't find the container with id 6524f3c61d06c21180e1df3d6814bb3b76b2cd330d0a7729ae55b36f4d24e04d
Jul 21 00:57:26.940536 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:26.940508    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:57:27.290000 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:27.289958    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" event={"ID":"3b6a6a0b-a395-4720-8e0c-1890c44ce480","Type":"ContainerStarted","Data":"6524f3c61d06c21180e1df3d6814bb3b76b2cd330d0a7729ae55b36f4d24e04d"}
Jul 21 00:57:28.295829 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:28.295791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" event={"ID":"3b6a6a0b-a395-4720-8e0c-1890c44ce480","Type":"ContainerStarted","Data":"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"}
Jul 21 00:57:28.296236 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:28.295914    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:28.313832 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:28.313784    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" podStartSLOduration=1.811357638 podStartE2EDuration="2.313765172s" totalImagesPullingTime="502.407534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:57:28.312852201 +0000 UTC m=+2434.670841443" watchObservedRunningTime="2026-07-21 00:57:28.313765172 +0000 UTC m=+2434.671754413"
Jul 21 00:57:32.111818 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:32.111782    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:57:34.305517 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.305485    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:57:34.563073 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.562987    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:57:34.566419 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.566402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.569124 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.569098    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a3348a-serving-cert\""
Jul 21 00:57:34.594214 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.594182    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:57:34.744261 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.744227    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.744461 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.744312    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhzqk\" (UniqueName: \"kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.744461 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.744341    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.845786 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.845695    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhzqk\" (UniqueName: \"kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.845786 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.845745    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.846049 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.845831    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.846431 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.846405    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.848562 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.848538    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.854209 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.854186    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhzqk\" (UniqueName: \"kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk\") pod \"maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:34.877365 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:34.877337    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:35.019211 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:35.019111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:57:35.022056 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:57:35.022030    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5f0db8_d76c_4850_a916_d77298d66b5d.slice/crio-89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185 WatchSource:0}: Error finding container 89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185: Status 404 returned error can't find the container with id 89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185
Jul 21 00:57:35.327978 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:35.327941    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" event={"ID":"6a5f0db8-d76c-4850-a916-d77298d66b5d","Type":"ContainerStarted","Data":"89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185"}
Jul 21 00:57:36.333908 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:36.333864    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" event={"ID":"6a5f0db8-d76c-4850-a916-d77298d66b5d","Type":"ContainerStarted","Data":"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"}
Jul 21 00:57:36.334265 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:36.333947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:36.351850 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:36.351797    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" podStartSLOduration=2.007776761 podStartE2EDuration="2.351780293s" totalImagesPullingTime="344.003532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:57:36.350746657 +0000 UTC m=+2442.708735896" watchObservedRunningTime="2026-07-21 00:57:36.351780293 +0000 UTC m=+2442.709769533"
Jul 21 00:57:42.343130 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:42.343097    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:57:44.897129 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:44.897095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:57:47.095703 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.095648    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"]
Jul 21 00:57:47.099101 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.099080    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:47.101344 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.101322    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:57:47.106387 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.106361    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"]
Jul 21 00:57:47.152537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.152507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7\" (UID: \"23391b7f-4085-43b1-a110-b3246d92ea82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:47.253327 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.253296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7\" (UID: \"23391b7f-4085-43b1-a110-b3246d92ea82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:47.253950 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.253929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7\" (UID: \"23391b7f-4085-43b1-a110-b3246d92ea82\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:47.412393 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.412306    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:47.546684 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:47.546635    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"]
Jul 21 00:57:47.553516 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:57:47.553479    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23391b7f_4085_43b1_a110_b3246d92ea82.slice/crio-da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861 WatchSource:0}: Error finding container da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861: Status 404 returned error can't find the container with id da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861
Jul 21 00:57:48.390372 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:48.390342    2576 generic.go:356] "Generic (PLEG): container finished" podID="23391b7f-4085-43b1-a110-b3246d92ea82" containerID="7b625f3b10554ba5397e82d3d89692c4c64606bb75c3aa5a13c8d28a7ea40021" exitCode=0
Jul 21 00:57:48.390696 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:48.390430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7" event={"ID":"23391b7f-4085-43b1-a110-b3246d92ea82","Type":"ContainerDied","Data":"7b625f3b10554ba5397e82d3d89692c4c64606bb75c3aa5a13c8d28a7ea40021"}
Jul 21 00:57:48.390696 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:48.390481    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7" event={"ID":"23391b7f-4085-43b1-a110-b3246d92ea82","Type":"ContainerStarted","Data":"da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861"}
Jul 21 00:57:49.521998 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:49.521976    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:49.574012 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:49.573981    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca\") pod \"23391b7f-4085-43b1-a110-b3246d92ea82\" (UID: \"23391b7f-4085-43b1-a110-b3246d92ea82\") "
Jul 21 00:57:49.574395 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:49.574367    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23391b7f-4085-43b1-a110-b3246d92ea82" (UID: "23391b7f-4085-43b1-a110-b3246d92ea82"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:57:49.674968 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:49.674888    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23391b7f-4085-43b1-a110-b3246d92ea82-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:57:50.402138 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:50.402055    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"
Jul 21 00:57:50.402306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:50.402056    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7" event={"ID":"23391b7f-4085-43b1-a110-b3246d92ea82","Type":"ContainerDied","Data":"da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861"}
Jul 21 00:57:50.402306 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:50.402191    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da2f66f769adec5c1360946efc9117a3835c5cf9995480f80d3fa7356adb9861"
Jul 21 00:57:54.254315 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:57:54.254284    2576 scope.go:117] "RemoveContainer" containerID="6736605fc203f8ea7b58820406da9d924c4d51d39087764d3f791bbea5f5129a"
Jul 21 00:58:02.824660 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:02.824620    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:58:02.825120 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:02.824995    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" podUID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" containerName="maas-api" containerID="cri-o://b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee" gracePeriod=30
Jul 21 00:58:03.075625 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.075549    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:58:03.196802 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.196763    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls\") pod \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") "
Jul 21 00:58:03.196968 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.196847    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-676ng\" (UniqueName: \"kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng\") pod \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") "
Jul 21 00:58:03.197019 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.197001    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca\") pod \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\" (UID: \"3b6a6a0b-a395-4720-8e0c-1890c44ce480\") "
Jul 21 00:58:03.197325 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.197295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3b6a6a0b-a395-4720-8e0c-1890c44ce480" (UID: "3b6a6a0b-a395-4720-8e0c-1890c44ce480"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:58:03.198978 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.198957    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng" (OuterVolumeSpecName: "kube-api-access-676ng") pod "3b6a6a0b-a395-4720-8e0c-1890c44ce480" (UID: "3b6a6a0b-a395-4720-8e0c-1890c44ce480"). InnerVolumeSpecName "kube-api-access-676ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:58:03.199066 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.199050    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3b6a6a0b-a395-4720-8e0c-1890c44ce480" (UID: "3b6a6a0b-a395-4720-8e0c-1890c44ce480"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:58:03.297879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.297851    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3b6a6a0b-a395-4720-8e0c-1890c44ce480-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:03.297879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.297877    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-676ng\" (UniqueName: \"kubernetes.io/projected/3b6a6a0b-a395-4720-8e0c-1890c44ce480-kube-api-access-676ng\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:03.297879 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.297887    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b6a6a0b-a395-4720-8e0c-1890c44ce480-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:03.464845 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.464809    2576 generic.go:356] "Generic (PLEG): container finished" podID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" containerID="b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee" exitCode=0
Jul 21 00:58:03.465017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.464850    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"
Jul 21 00:58:03.465017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.464896    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" event={"ID":"3b6a6a0b-a395-4720-8e0c-1890c44ce480","Type":"ContainerDied","Data":"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"}
Jul 21 00:58:03.465017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.464943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z" event={"ID":"3b6a6a0b-a395-4720-8e0c-1890c44ce480","Type":"ContainerDied","Data":"6524f3c61d06c21180e1df3d6814bb3b76b2cd330d0a7729ae55b36f4d24e04d"}
Jul 21 00:58:03.465017 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.464967    2576 scope.go:117] "RemoveContainer" containerID="b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"
Jul 21 00:58:03.474415 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.474400    2576 scope.go:117] "RemoveContainer" containerID="b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"
Jul 21 00:58:03.474713 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:58:03.474696    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee\": container with ID starting with b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee not found: ID does not exist" containerID="b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"
Jul 21 00:58:03.474782 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.474725    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee"} err="failed to get container status \"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee\": rpc error: code = NotFound desc = could not find container \"b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee\": container with ID starting with b79ad1e0f83a8d1a45e364b445e4069a62d15133a441d70f32c9797520b718ee not found: ID does not exist"
Jul 21 00:58:03.485200 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.485174    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:58:03.489450 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:03.489429    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e541cf-7ccb89c4d6-z6m4z"]
Jul 21 00:58:04.079955 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:04.079921    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" path="/var/lib/kubelet/pods/3b6a6a0b-a395-4720-8e0c-1890c44ce480/volumes"
Jul 21 00:58:05.590889 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:05.590856    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:58:07.185408 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:07.185372    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"]
Jul 21 00:58:07.189905 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:07.189874    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e541cf-kn6r7"]
Jul 21 00:58:08.080276 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:08.080241    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23391b7f-4085-43b1-a110-b3246d92ea82" path="/var/lib/kubelet/pods/23391b7f-4085-43b1-a110-b3246d92ea82/volumes"
Jul 21 00:58:14.269490 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269460    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"]
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269785    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23391b7f-4085-43b1-a110-b3246d92ea82" containerName="revoke-keys"
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269796    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23391b7f-4085-43b1-a110-b3246d92ea82" containerName="revoke-keys"
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269822    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" containerName="maas-api"
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269827    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" containerName="maas-api"
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269875    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="23391b7f-4085-43b1-a110-b3246d92ea82" containerName="revoke-keys"
Jul 21 00:58:14.269980 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.269884    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b6a6a0b-a395-4720-8e0c-1890c44ce480" containerName="maas-api"
Jul 21 00:58:14.274358 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.274342    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:14.276386 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.276361    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 00:58:14.280201 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.280178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"]
Jul 21 00:58:14.398847 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.398795    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5\" (UID: \"256d4e71-5c45-4832-81b4-66ceac3acb0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:14.499598 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.499564    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5\" (UID: \"256d4e71-5c45-4832-81b4-66ceac3acb0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:14.500189 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.500167    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5\" (UID: \"256d4e71-5c45-4832-81b4-66ceac3acb0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:14.585864 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.585780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:14.720197 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:14.720131    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"]
Jul 21 00:58:14.722875 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:58:14.722846    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod256d4e71_5c45_4832_81b4_66ceac3acb0f.slice/crio-3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5 WatchSource:0}: Error finding container 3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5: Status 404 returned error can't find the container with id 3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5
Jul 21 00:58:15.520959 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:15.520917    2576 generic.go:356] "Generic (PLEG): container finished" podID="256d4e71-5c45-4832-81b4-66ceac3acb0f" containerID="654decfb123a0852af6c2565eb60d447028715353e9a29847b6dd3c568c18d84" exitCode=0
Jul 21 00:58:15.521383 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:15.520966    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5" event={"ID":"256d4e71-5c45-4832-81b4-66ceac3acb0f","Type":"ContainerDied","Data":"654decfb123a0852af6c2565eb60d447028715353e9a29847b6dd3c568c18d84"}
Jul 21 00:58:15.521383 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:15.521020    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5" event={"ID":"256d4e71-5c45-4832-81b4-66ceac3acb0f","Type":"ContainerStarted","Data":"3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5"}
Jul 21 00:58:16.667064 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:16.667040    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:16.821537 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:16.821459    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca\") pod \"256d4e71-5c45-4832-81b4-66ceac3acb0f\" (UID: \"256d4e71-5c45-4832-81b4-66ceac3acb0f\") "
Jul 21 00:58:16.821824 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:16.821804    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "256d4e71-5c45-4832-81b4-66ceac3acb0f" (UID: "256d4e71-5c45-4832-81b4-66ceac3acb0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:58:16.922765 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:16.922738    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/256d4e71-5c45-4832-81b4-66ceac3acb0f-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:17.532469 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:17.532439    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"
Jul 21 00:58:17.532469 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:17.532453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5" event={"ID":"256d4e71-5c45-4832-81b4-66ceac3acb0f","Type":"ContainerDied","Data":"3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5"}
Jul 21 00:58:17.532695 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:17.532497    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3aa16e3605af400454a76265c27aec7911001634a9f854992b46876499857bd5"
Jul 21 00:58:29.707560 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:29.707527    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:58:29.708006 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:29.707749    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" podUID="6a5f0db8-d76c-4850-a916-d77298d66b5d" containerName="maas-api" containerID="cri-o://f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849" gracePeriod=30
Jul 21 00:58:29.953616 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:29.953591    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:58:30.030372 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.030277    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhzqk\" (UniqueName: \"kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk\") pod \"6a5f0db8-d76c-4850-a916-d77298d66b5d\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") "
Jul 21 00:58:30.030372 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.030349    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls\") pod \"6a5f0db8-d76c-4850-a916-d77298d66b5d\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") "
Jul 21 00:58:30.030588 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.030413    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca\") pod \"6a5f0db8-d76c-4850-a916-d77298d66b5d\" (UID: \"6a5f0db8-d76c-4850-a916-d77298d66b5d\") "
Jul 21 00:58:30.030799 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.030775    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a5f0db8-d76c-4850-a916-d77298d66b5d" (UID: "6a5f0db8-d76c-4850-a916-d77298d66b5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 00:58:30.032585 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.032564    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a5f0db8-d76c-4850-a916-d77298d66b5d" (UID: "6a5f0db8-d76c-4850-a916-d77298d66b5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 00:58:30.032697 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.032662    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk" (OuterVolumeSpecName: "kube-api-access-rhzqk") pod "6a5f0db8-d76c-4850-a916-d77298d66b5d" (UID: "6a5f0db8-d76c-4850-a916-d77298d66b5d"). InnerVolumeSpecName "kube-api-access-rhzqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 00:58:30.106578 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:58:30.106538    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a5f0db8_d76c_4850_a916_d77298d66b5d.slice/crio-89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185\": RecentStats: unable to find data in memory cache]"
Jul 21 00:58:30.131857 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.131829    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a5f0db8-d76c-4850-a916-d77298d66b5d-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:30.131857 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.131854    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhzqk\" (UniqueName: \"kubernetes.io/projected/6a5f0db8-d76c-4850-a916-d77298d66b5d-kube-api-access-rhzqk\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:30.132008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.131864    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a5f0db8-d76c-4850-a916-d77298d66b5d-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 00:58:30.591828 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.591790    2576 generic.go:356] "Generic (PLEG): container finished" podID="6a5f0db8-d76c-4850-a916-d77298d66b5d" containerID="f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849" exitCode=0
Jul 21 00:58:30.592008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.591861    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"
Jul 21 00:58:30.592008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.591881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" event={"ID":"6a5f0db8-d76c-4850-a916-d77298d66b5d","Type":"ContainerDied","Data":"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"}
Jul 21 00:58:30.592008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.591968    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq" event={"ID":"6a5f0db8-d76c-4850-a916-d77298d66b5d","Type":"ContainerDied","Data":"89751b0bba95cbae9ceb39de0c3704b8b7ae656e828a329a5913fdbe7057d185"}
Jul 21 00:58:30.592008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.591997    2576 scope.go:117] "RemoveContainer" containerID="f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"
Jul 21 00:58:30.600653 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.600630    2576 scope.go:117] "RemoveContainer" containerID="f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"
Jul 21 00:58:30.600964 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:58:30.600944    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849\": container with ID starting with f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849 not found: ID does not exist" containerID="f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"
Jul 21 00:58:30.601008 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.600970    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849"} err="failed to get container status \"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849\": rpc error: code = NotFound desc = could not find container \"f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849\": container with ID starting with f49ca9812cb0c64b478c607d2e823b7a66f0d14417c03d9d78b84b12f7c3a849 not found: ID does not exist"
Jul 21 00:58:30.607066 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.607041    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:58:30.609648 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:30.609626    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a3348a-b56d4f94f-gpglq"]
Jul 21 00:58:32.079620 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:32.079580    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a5f0db8-d76c-4850-a916-d77298d66b5d" path="/var/lib/kubelet/pods/6a5f0db8-d76c-4850-a916-d77298d66b5d/volumes"
Jul 21 00:58:34.351026 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:34.350987    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"]
Jul 21 00:58:34.352392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:34.352373    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a3348a-dj2p5"]
Jul 21 00:58:35.301027 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:35.300990    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:58:36.078847 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:36.078813    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="256d4e71-5c45-4832-81b4-66ceac3acb0f" path="/var/lib/kubelet/pods/256d4e71-5c45-4832-81b4-66ceac3acb0f/volumes"
Jul 21 00:58:45.047474 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.047381    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 00:58:45.047907 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.047878    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a5f0db8-d76c-4850-a916-d77298d66b5d" containerName="maas-api"
Jul 21 00:58:45.047907 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.047898    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a5f0db8-d76c-4850-a916-d77298d66b5d" containerName="maas-api"
Jul 21 00:58:45.047992 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.047936    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="256d4e71-5c45-4832-81b4-66ceac3acb0f" containerName="revoke-keys"
Jul 21 00:58:45.047992 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.047945    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="256d4e71-5c45-4832-81b4-66ceac3acb0f" containerName="revoke-keys"
Jul 21 00:58:45.048062 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.048023    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a5f0db8-d76c-4850-a916-d77298d66b5d" containerName="maas-api"
Jul 21 00:58:45.048062 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.048035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="256d4e71-5c45-4832-81b4-66ceac3acb0f" containerName="revoke-keys"
Jul 21 00:58:45.052455 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.052434    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.054743 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.054718    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 21 00:58:45.055392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.055363    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-16b734-serving-cert\""
Jul 21 00:58:45.055392 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.055380    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 00:58:45.055526 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.055381    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-572xg\""
Jul 21 00:58:45.060546 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.060248    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 00:58:45.157007 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.156974    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.157174 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.157016    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.157174 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.157094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9cp\" (UniqueName: \"kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.258090 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.258051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9cp\" (UniqueName: \"kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.258334 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.258129    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.258334 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.258153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.258334 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:58:45.258253    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-serving-cert: secret "maas-api-e2e-shared-a-16b734-serving-cert" not found
Jul 21 00:58:45.258334 ip-10-0-141-120 kubenswrapper[2576]: E0721 00:58:45.258311    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls podName:8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd nodeName:}" failed. No retries permitted until 2026-07-21 00:58:45.758296691 +0000 UTC m=+2512.116285910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls") pod "maas-api-e2e-shared-a-16b734-578478d484-97v78" (UID: "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd") : secret "maas-api-e2e-shared-a-16b734-serving-cert" not found
Jul 21 00:58:45.258872 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.258852    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.268983 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.268964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9cp\" (UniqueName: \"kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.762914 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.762872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.765476 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.765443    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") pod \"maas-api-e2e-shared-a-16b734-578478d484-97v78\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:45.964355 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:45.964307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:46.097510 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.097483    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 00:58:46.099970 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:58:46.099942    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c1b54ca_e52c_4d6b_a662_1f90c1b67bbd.slice/crio-ae909003a750f342647ff7232a455c9138237aec2c235b7a40761323ead26f82 WatchSource:0}: Error finding container ae909003a750f342647ff7232a455c9138237aec2c235b7a40761323ead26f82: Status 404 returned error can't find the container with id ae909003a750f342647ff7232a455c9138237aec2c235b7a40761323ead26f82
Jul 21 00:58:46.101216 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.101198    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 00:58:46.670969 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.670931    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" event={"ID":"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd","Type":"ContainerStarted","Data":"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"}
Jul 21 00:58:46.671124 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.670981    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" event={"ID":"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd","Type":"ContainerStarted","Data":"ae909003a750f342647ff7232a455c9138237aec2c235b7a40761323ead26f82"}
Jul 21 00:58:46.671124 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.671064    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:46.688738 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:46.688691    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" podStartSLOduration=1.199287364 podStartE2EDuration="1.688655877s" totalImagesPullingTime="489.368513ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:58:46.685924595 +0000 UTC m=+2513.043913836" watchObservedRunningTime="2026-07-21 00:58:46.688655877 +0000 UTC m=+2513.046645094"
Jul 21 00:58:50.103244 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:50.103211    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:58:52.681060 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:52.681021    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 00:58:52.981859 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:52.981829    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 00:58:52.986226 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:52.986204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:52.988385 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:52.988361    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b4ed4b-serving-cert\""
Jul 21 00:58:52.996167 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:52.996145    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 00:58:53.032595 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.032564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.032820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.032612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxh2s\" (UniqueName: \"kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.032820 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.032770    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.133838 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.133799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.134034 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.133853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.134034 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.133887    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxh2s\" (UniqueName: \"kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.134538 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.134516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.136407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.136388    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.141425 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.141408    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxh2s\" (UniqueName: \"kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s\") pod \"maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.299186 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.299107    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:53.436295 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.436256    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 00:58:53.439076 ip-10-0-141-120 kubenswrapper[2576]: W0721 00:58:53.439048    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7b08a0_e3d1_46b2_9d88_4469d9fa47f7.slice/crio-01ab5ddf2307fdec98ba03da12209b0b3758edcfb920818ddc0d214f8b3529e9 WatchSource:0}: Error finding container 01ab5ddf2307fdec98ba03da12209b0b3758edcfb920818ddc0d214f8b3529e9: Status 404 returned error can't find the container with id 01ab5ddf2307fdec98ba03da12209b0b3758edcfb920818ddc0d214f8b3529e9
Jul 21 00:58:53.705069 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:53.705034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" event={"ID":"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7","Type":"ContainerStarted","Data":"01ab5ddf2307fdec98ba03da12209b0b3758edcfb920818ddc0d214f8b3529e9"}
Jul 21 00:58:54.710478 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:54.710441    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" event={"ID":"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7","Type":"ContainerStarted","Data":"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"}
Jul 21 00:58:54.710985 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:54.710510    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:58:54.727934 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:58:54.727885    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" podStartSLOduration=2.263488004 podStartE2EDuration="2.727869639s" totalImagesPullingTime="464.381635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 00:58:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 00:58:54.72513688 +0000 UTC m=+2521.083126313" watchObservedRunningTime="2026-07-21 00:58:54.727869639 +0000 UTC m=+2521.085858878"
Jul 21 00:59:00.724361 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:59:00.724333    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 00:59:02.891407 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:59:02.891371    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:59:14.394695 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:59:14.394648    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:59:46.192733 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:59:46.192692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 00:59:54.291724 ip-10-0-141-120 kubenswrapper[2576]: I0721 00:59:54.291693    2576 scope.go:117] "RemoveContainer" containerID="9c69bfd11240b176aed9ca217d0acddf760264fceb46ce2123857992bb06b534"
Jul 21 01:00:00.131923 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.131891    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"]
Jul 21 01:00:00.134941 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.134924    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"]
Jul 21 01:00:00.135058 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.135040    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"
Jul 21 01:00:00.137116 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.137099    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 01:00:00.137999 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.137981    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"]
Jul 21 01:00:00.138083 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.138069    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"
Jul 21 01:00:00.141928 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.141898    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"
Jul 21 01:00:00.143839 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.143818    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"]
Jul 21 01:00:00.145689 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.145656    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"]
Jul 21 01:00:00.147435 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.147410    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"]
Jul 21 01:00:00.148537 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.148521    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"
Jul 21 01:00:00.156766 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.156740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"
Jul 21 01:00:00.163544 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.163527    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"
Jul 21 01:00:00.312205 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.312180    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"]
Jul 21 01:00:00.316112 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:00:00.316082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60245b59_dafb_4297_8a17_18fd5fd09fd4.slice/crio-b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be WatchSource:0}: Error finding container b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be: Status 404 returned error can't find the container with id b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be
Jul 21 01:00:00.543000 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.542946    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"]
Jul 21 01:00:00.546572 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.546549    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"]
Jul 21 01:00:00.546806 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:00:00.546767    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16ec71c_de1e_4d9f_81aa_fbced006c274.slice/crio-af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10 WatchSource:0}: Error finding container af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10: Status 404 returned error can't find the container with id af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10
Jul 21 01:00:00.548742 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:00:00.548721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3a0a38_f4f6_4747_b164_194f45f1f2a8.slice/crio-3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3 WatchSource:0}: Error finding container 3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3: Status 404 returned error can't find the container with id 3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3
Jul 21 01:00:00.693054 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:00.693021    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:00:01.014744 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.014703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj" event={"ID":"60245b59-dafb-4297-8a17-18fd5fd09fd4","Type":"ContainerStarted","Data":"501bc07d2f9b8e77197cb7ffa7ce69090cdba0dc33a86fb2024962795473c6ee"}
Jul 21 01:00:01.014930 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.014761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj" event={"ID":"60245b59-dafb-4297-8a17-18fd5fd09fd4","Type":"ContainerStarted","Data":"b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be"}
Jul 21 01:00:01.016156 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.016128    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd" event={"ID":"5f3a0a38-f4f6-4747-b164-194f45f1f2a8","Type":"ContainerStarted","Data":"6898e4f077c3e7407a8f3bc8d819d46f9214159dfa29f988979e9258d3d20809"}
Jul 21 01:00:01.016294 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.016175    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd" event={"ID":"5f3a0a38-f4f6-4747-b164-194f45f1f2a8","Type":"ContainerStarted","Data":"3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3"}
Jul 21 01:00:01.017360 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.017337    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g" event={"ID":"c16ec71c-de1e-4d9f-81aa-fbced006c274","Type":"ContainerStarted","Data":"6ab5efac818f725d3f8b49d0755f13161661c1ec938cde88110ee3c796f3948b"}
Jul 21 01:00:01.017455 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.017381    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g" event={"ID":"c16ec71c-de1e-4d9f-81aa-fbced006c274","Type":"ContainerStarted","Data":"af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10"}
Jul 21 01:00:01.032453 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.032411    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj" podStartSLOduration=1.032397264 podStartE2EDuration="1.032397264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:00:01.030898565 +0000 UTC m=+2587.388887806" watchObservedRunningTime="2026-07-21 01:00:01.032397264 +0000 UTC m=+2587.390386518"
Jul 21 01:00:01.044597 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.044513    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd" podStartSLOduration=1.044500994 podStartE2EDuration="1.044500994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:00:01.043744999 +0000 UTC m=+2587.401734246" watchObservedRunningTime="2026-07-21 01:00:01.044500994 +0000 UTC m=+2587.402490211"
Jul 21 01:00:01.057488 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:01.057444    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g" podStartSLOduration=1.057430667 podStartE2EDuration="1.057430667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:00:01.056874464 +0000 UTC m=+2587.414863708" watchObservedRunningTime="2026-07-21 01:00:01.057430667 +0000 UTC m=+2587.415419906"
Jul 21 01:00:02.024145 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.024109    2576 generic.go:356] "Generic (PLEG): container finished" podID="5f3a0a38-f4f6-4747-b164-194f45f1f2a8" containerID="6898e4f077c3e7407a8f3bc8d819d46f9214159dfa29f988979e9258d3d20809" exitCode=0
Jul 21 01:00:02.024602 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.024207    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd" event={"ID":"5f3a0a38-f4f6-4747-b164-194f45f1f2a8","Type":"ContainerDied","Data":"6898e4f077c3e7407a8f3bc8d819d46f9214159dfa29f988979e9258d3d20809"}
Jul 21 01:00:02.025508 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.025488    2576 generic.go:356] "Generic (PLEG): container finished" podID="c16ec71c-de1e-4d9f-81aa-fbced006c274" containerID="6ab5efac818f725d3f8b49d0755f13161661c1ec938cde88110ee3c796f3948b" exitCode=0
Jul 21 01:00:02.025576 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.025513    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g" event={"ID":"c16ec71c-de1e-4d9f-81aa-fbced006c274","Type":"ContainerDied","Data":"6ab5efac818f725d3f8b49d0755f13161661c1ec938cde88110ee3c796f3948b"}
Jul 21 01:00:02.026871 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.026851    2576 generic.go:356] "Generic (PLEG): container finished" podID="60245b59-dafb-4297-8a17-18fd5fd09fd4" containerID="501bc07d2f9b8e77197cb7ffa7ce69090cdba0dc33a86fb2024962795473c6ee" exitCode=0
Jul 21 01:00:02.026966 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:02.026897    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj" event={"ID":"60245b59-dafb-4297-8a17-18fd5fd09fd4","Type":"ContainerDied","Data":"501bc07d2f9b8e77197cb7ffa7ce69090cdba0dc33a86fb2024962795473c6ee"}
Jul 21 01:00:03.190358 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:03.190330    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"
Jul 21 01:00:03.212210 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:03.212188    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"
Jul 21 01:00:03.222357 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:03.222335    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"
Jul 21 01:00:04.036604 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.036572    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj"
Jul 21 01:00:04.036821 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.036608    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29743260-7wcdj" event={"ID":"60245b59-dafb-4297-8a17-18fd5fd09fd4","Type":"ContainerDied","Data":"b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be"}
Jul 21 01:00:04.036821 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.036654    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6239bdaf544bb3372442fdbb56e7a63160b7fd54f20e9592bbd6b6c8db2f8be"
Jul 21 01:00:04.037860 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.037841    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"
Jul 21 01:00:04.037860 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.037853    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd" event={"ID":"5f3a0a38-f4f6-4747-b164-194f45f1f2a8","Type":"ContainerDied","Data":"3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3"}
Jul 21 01:00:04.038020 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.037894    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3fe0aa4e9c839a7996be5835e1e3a7fd411399bdb1ea4d98097a2bce496be2c3"
Jul 21 01:00:04.039336 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.039311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g" event={"ID":"c16ec71c-de1e-4d9f-81aa-fbced006c274","Type":"ContainerDied","Data":"af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10"}
Jul 21 01:00:04.039456 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.039339    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"
Jul 21 01:00:04.039456 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:04.039360    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af62b2475c7718d8e3e760602651d4b910cad7b610e1d288af0a96cb7c142f10"
Jul 21 01:00:13.299836 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:13.299800    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:00:27.199591 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:27.199554    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:00:46.996037 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:00:46.995998    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:01:01.092412 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:01.092377    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:01:18.799386 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:18.799349    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:01:38.795849 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:38.795809    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:01:54.206291 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:54.206261    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 01:01:54.213441 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:54.213422    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c74q9_79e22b50-c889-4f00-bace-83910f1a4bca/ovn-acl-logging/0.log"
Jul 21 01:01:55.692997 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:01:55.692960    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:02:05.992259 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:02:05.992204    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:02:26.898814 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:02:26.898766    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:02:41.802728 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:02:41.802689    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:02:54.322505 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:02:54.322470    2576 scope.go:117] "RemoveContainer" containerID="26e311aacc75e86f63f81b8819cda38f4b2e997abeb7f2e246a39192d7364747"
Jul 21 01:03:02.893919 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:03:02.893882    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:03:21.488098 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:03:21.488060    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:03:35.698923 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:03:35.698881    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:03:54.340922 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:03:54.340890    2576 scope.go:117] "RemoveContainer" containerID="7b625f3b10554ba5397e82d3d89692c4c64606bb75c3aa5a13c8d28a7ea40021"
Jul 21 01:03:54.349026 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:03:54.349005    2576 scope.go:117] "RemoveContainer" containerID="56f213b4edb04c183bfb91d24f8926d0f9ce6d12fb5ab09db6512e97bc87253a"
Jul 21 01:04:07.894695 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:04:07.894643    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:04:23.097214 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:04:23.097178    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:04:38.194451 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:04:38.194414    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:04:52.298999 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:04:52.298914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:04:54.370979 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:04:54.370935    2576 scope.go:117] "RemoveContainer" containerID="654decfb123a0852af6c2565eb60d447028715353e9a29847b6dd3c568c18d84"
Jul 21 01:05:05.755149 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755115    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"]
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755424    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3a0a38-f4f6-4747-b164-194f45f1f2a8" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755435    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3a0a38-f4f6-4747-b164-194f45f1f2a8" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755445    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c16ec71c-de1e-4d9f-81aa-fbced006c274" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755450    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c16ec71c-de1e-4d9f-81aa-fbced006c274" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755463    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60245b59-dafb-4297-8a17-18fd5fd09fd4" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755469    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="60245b59-dafb-4297-8a17-18fd5fd09fd4" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755528    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c16ec71c-de1e-4d9f-81aa-fbced006c274" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755537    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="60245b59-dafb-4297-8a17-18fd5fd09fd4" containerName="cleanup"
Jul 21 01:05:05.755594 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.755546    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3a0a38-f4f6-4747-b164-194f45f1f2a8" containerName="cleanup"
Jul 21 01:05:05.758445 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.758429    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:05.760711 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.760694    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 01:05:05.765658 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.765472    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"]
Jul 21 01:05:05.863976 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.863945    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j\" (UID: \"243ac9c0-a455-4f85-b872-77f2c5022698\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:05.964701 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.964647    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j\" (UID: \"243ac9c0-a455-4f85-b872-77f2c5022698\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:05.965305 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:05.965283    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j\" (UID: \"243ac9c0-a455-4f85-b872-77f2c5022698\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:06.069704 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:06.069608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:06.200357 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:06.200329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"]
Jul 21 01:05:06.203071 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:05:06.203040    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243ac9c0_a455_4f85_b872_77f2c5022698.slice/crio-f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88 WatchSource:0}: Error finding container f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88: Status 404 returned error can't find the container with id f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88
Jul 21 01:05:06.450617 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:06.450579    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j" event={"ID":"243ac9c0-a455-4f85-b872-77f2c5022698","Type":"ContainerStarted","Data":"f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88"}
Jul 21 01:05:06.905607 ip-10-0-141-120 kubenswrapper[2576]: E0721 01:05:06.905582    2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243ac9c0_a455_4f85_b872_77f2c5022698.slice/crio-7b831d9b36c2bf0596a223295b69925ddd6b56162cb2674a9dc8af165e7b317a.scope\": RecentStats: unable to find data in memory cache]"
Jul 21 01:05:07.456418 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:07.456380    2576 generic.go:356] "Generic (PLEG): container finished" podID="243ac9c0-a455-4f85-b872-77f2c5022698" containerID="7b831d9b36c2bf0596a223295b69925ddd6b56162cb2674a9dc8af165e7b317a" exitCode=0
Jul 21 01:05:07.456625 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:07.456470    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j" event={"ID":"243ac9c0-a455-4f85-b872-77f2c5022698","Type":"ContainerDied","Data":"7b831d9b36c2bf0596a223295b69925ddd6b56162cb2674a9dc8af165e7b317a"}
Jul 21 01:05:08.591582 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:08.591556    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:08.688018 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:08.687980    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca\") pod \"243ac9c0-a455-4f85-b872-77f2c5022698\" (UID: \"243ac9c0-a455-4f85-b872-77f2c5022698\") "
Jul 21 01:05:08.688351 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:08.688328    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "243ac9c0-a455-4f85-b872-77f2c5022698" (UID: "243ac9c0-a455-4f85-b872-77f2c5022698"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:05:08.788591 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:08.788513    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/243ac9c0-a455-4f85-b872-77f2c5022698-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:09.468067 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:09.468033    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j" event={"ID":"243ac9c0-a455-4f85-b872-77f2c5022698","Type":"ContainerDied","Data":"f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88"}
Jul 21 01:05:09.468240 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:09.468087    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f62890b83f95529ca906b942bd1763a9545ac6501e021da968fe2096426c3f88"
Jul 21 01:05:09.468240 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:09.468044    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"
Jul 21 01:05:16.214502 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.214472    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 01:05:16.214960 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.214737    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" podUID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" containerName="maas-api" containerID="cri-o://b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d" gracePeriod=30
Jul 21 01:05:16.240513 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.240492    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"]
Jul 21 01:05:16.242888 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.242867    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-16b734-29743260-smx6g"]
Jul 21 01:05:16.465486 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.465430    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 01:05:16.499761 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.499729    2576 generic.go:356] "Generic (PLEG): container finished" podID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" containerID="b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d" exitCode=0
Jul 21 01:05:16.499885 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.499773    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"
Jul 21 01:05:16.499885 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.499790    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" event={"ID":"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd","Type":"ContainerDied","Data":"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"}
Jul 21 01:05:16.499885 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.499832    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78" event={"ID":"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd","Type":"ContainerDied","Data":"ae909003a750f342647ff7232a455c9138237aec2c235b7a40761323ead26f82"}
Jul 21 01:05:16.499885 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.499860    2576 scope.go:117] "RemoveContainer" containerID="b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"
Jul 21 01:05:16.509075 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.509055    2576 scope.go:117] "RemoveContainer" containerID="b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"
Jul 21 01:05:16.509359 ip-10-0-141-120 kubenswrapper[2576]: E0721 01:05:16.509339    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d\": container with ID starting with b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d not found: ID does not exist" containerID="b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"
Jul 21 01:05:16.509443 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.509366    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d"} err="failed to get container status \"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d\": rpc error: code = NotFound desc = could not find container \"b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d\": container with ID starting with b872640f7b63a683f06c38f8913c4308836c9b16118aee88cade87e8c653856d not found: ID does not exist"
Jul 21 01:05:16.552105 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.552079    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq9cp\" (UniqueName: \"kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp\") pod \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") "
Jul 21 01:05:16.552266 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.552114    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca\") pod \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") "
Jul 21 01:05:16.552266 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.552170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") pod \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\" (UID: \"8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd\") "
Jul 21 01:05:16.552575 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.552550    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" (UID: "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:05:16.554258 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.554226    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp" (OuterVolumeSpecName: "kube-api-access-gq9cp") pod "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" (UID: "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd"). InnerVolumeSpecName "kube-api-access-gq9cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:05:16.554374 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.554356    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" (UID: "8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:05:16.653541 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.653518    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:16.653541 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.653540    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq9cp\" (UniqueName: \"kubernetes.io/projected/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-kube-api-access-gq9cp\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:16.653694 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.653550    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:16.821023 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.820989    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 01:05:16.824946 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:16.824921    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-16b734-578478d484-97v78"]
Jul 21 01:05:18.079124 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:18.079087    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" path="/var/lib/kubelet/pods/8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd/volumes"
Jul 21 01:05:18.079484 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:18.079344    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c16ec71c-de1e-4d9f-81aa-fbced006c274" path="/var/lib/kubelet/pods/c16ec71c-de1e-4d9f-81aa-fbced006c274/volumes"
Jul 21 01:05:19.288357 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:19.288319    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:05:20.882813 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:20.882781    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"]
Jul 21 01:05:20.885189 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:20.885164    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-16b734-pnt8j"]
Jul 21 01:05:22.079597 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:22.079564    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="243ac9c0-a455-4f85-b872-77f2c5022698" path="/var/lib/kubelet/pods/243ac9c0-a455-4f85-b872-77f2c5022698/volumes"
Jul 21 01:05:27.654357 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654320    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"]
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654643    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="243ac9c0-a455-4f85-b872-77f2c5022698" containerName="revoke-keys"
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654654    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="243ac9c0-a455-4f85-b872-77f2c5022698" containerName="revoke-keys"
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654680    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" containerName="maas-api"
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654686    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" containerName="maas-api"
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654747    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c1b54ca-e52c-4d6b-a662-1f90c1b67bbd" containerName="maas-api"
Jul 21 01:05:27.654827 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.654755    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="243ac9c0-a455-4f85-b872-77f2c5022698" containerName="revoke-keys"
Jul 21 01:05:27.659191 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.659171    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:27.661386 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.661364    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-gxv7p\""
Jul 21 01:05:27.664740 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.664715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"]
Jul 21 01:05:27.747769 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.747736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8\" (UID: \"cda41a90-ee3b-42f7-90ec-78a15f54e2a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:27.848989 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.848957    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8\" (UID: \"cda41a90-ee3b-42f7-90ec-78a15f54e2a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:27.849566 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.849546    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8\" (UID: \"cda41a90-ee3b-42f7-90ec-78a15f54e2a0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:27.970746 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:27.970716    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:28.100436 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:28.100411    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"]
Jul 21 01:05:28.103106 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:05:28.103080    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcda41a90_ee3b_42f7_90ec_78a15f54e2a0.slice/crio-b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd WatchSource:0}: Error finding container b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd: Status 404 returned error can't find the container with id b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd
Jul 21 01:05:28.563401 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:28.563323    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8" event={"ID":"cda41a90-ee3b-42f7-90ec-78a15f54e2a0","Type":"ContainerStarted","Data":"9304037f9c5d2430dc8daf41b5d82331719f3f335b2acfe3f7d4fae2b3765ddd"}
Jul 21 01:05:28.563401 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:28.563372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8" event={"ID":"cda41a90-ee3b-42f7-90ec-78a15f54e2a0","Type":"ContainerStarted","Data":"b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd"}
Jul 21 01:05:28.578794 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:28.578746    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8" podStartSLOduration=1.578731836 podStartE2EDuration="1.578731836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 01:05:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:05:28.577255939 +0000 UTC m=+2914.935245194" watchObservedRunningTime="2026-07-21 01:05:28.578731836 +0000 UTC m=+2914.936721077"
Jul 21 01:05:29.569170 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:29.569133    2576 generic.go:356] "Generic (PLEG): container finished" podID="cda41a90-ee3b-42f7-90ec-78a15f54e2a0" containerID="9304037f9c5d2430dc8daf41b5d82331719f3f335b2acfe3f7d4fae2b3765ddd" exitCode=0
Jul 21 01:05:29.569170 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:29.569176    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8" event={"ID":"cda41a90-ee3b-42f7-90ec-78a15f54e2a0","Type":"ContainerDied","Data":"9304037f9c5d2430dc8daf41b5d82331719f3f335b2acfe3f7d4fae2b3765ddd"}
Jul 21 01:05:30.704325 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:30.704303    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:30.772042 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:30.772010    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca\") pod \"cda41a90-ee3b-42f7-90ec-78a15f54e2a0\" (UID: \"cda41a90-ee3b-42f7-90ec-78a15f54e2a0\") "
Jul 21 01:05:30.772331 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:30.772309    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cda41a90-ee3b-42f7-90ec-78a15f54e2a0" (UID: "cda41a90-ee3b-42f7-90ec-78a15f54e2a0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:05:30.873174 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:30.873086    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cda41a90-ee3b-42f7-90ec-78a15f54e2a0-maas-api-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:31.580330 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:31.580288    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8" event={"ID":"cda41a90-ee3b-42f7-90ec-78a15f54e2a0","Type":"ContainerDied","Data":"b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd"}
Jul 21 01:05:31.580587 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:31.580572    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2a4c36f8912b63f6fd5162862ce37582641bcae6afcb8c462764ee6a1f0e4fd"
Jul 21 01:05:31.580787 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:31.580774    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"
Jul 21 01:05:38.273226 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.273189    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 01:05:38.273615 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.273378    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" podUID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" containerName="maas-api" containerID="cri-o://8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7" gracePeriod=30
Jul 21 01:05:38.305501 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.305465    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"]
Jul 21 01:05:38.308311 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.308286    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b4ed4b-29743260-qr2gd"]
Jul 21 01:05:38.519085 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.519064    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 01:05:38.612790 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.612694    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" containerID="8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7" exitCode=0
Jul 21 01:05:38.612790 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.612745    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"
Jul 21 01:05:38.613009 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.612788    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" event={"ID":"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7","Type":"ContainerDied","Data":"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"}
Jul 21 01:05:38.613009 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.612841    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h" event={"ID":"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7","Type":"ContainerDied","Data":"01ab5ddf2307fdec98ba03da12209b0b3758edcfb920818ddc0d214f8b3529e9"}
Jul 21 01:05:38.613009 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.612870    2576 scope.go:117] "RemoveContainer" containerID="8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"
Jul 21 01:05:38.621128 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.621112    2576 scope.go:117] "RemoveContainer" containerID="8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"
Jul 21 01:05:38.621385 ip-10-0-141-120 kubenswrapper[2576]: E0721 01:05:38.621367    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7\": container with ID starting with 8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7 not found: ID does not exist" containerID="8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"
Jul 21 01:05:38.621438 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.621395    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7"} err="failed to get container status \"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7\": rpc error: code = NotFound desc = could not find container \"8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7\": container with ID starting with 8d072467f1192e02c31a076112653b630b4eef1c229b349804ede405552dffa7 not found: ID does not exist"
Jul 21 01:05:38.635714 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.635694    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls\") pod \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") "
Jul 21 01:05:38.635810 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.635749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca\") pod \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") "
Jul 21 01:05:38.635879 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.635817    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxh2s\" (UniqueName: \"kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s\") pod \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\" (UID: \"9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7\") "
Jul 21 01:05:38.636017 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.635992    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" (UID: "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 01:05:38.637872 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.637852    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s" (OuterVolumeSpecName: "kube-api-access-bxh2s") pod "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" (UID: "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7"). InnerVolumeSpecName "kube-api-access-bxh2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 01:05:38.637992 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.637974    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" (UID: "9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 01:05:38.736954 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.736923    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-maas-api-tls\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:38.736954 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.736950    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-openshift-service-ca\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:38.736954 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.736959    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxh2s\" (UniqueName: \"kubernetes.io/projected/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7-kube-api-access-bxh2s\") on node \"ip-10-0-141-120.ec2.internal\" DevicePath \"\""
Jul 21 01:05:38.933058 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.933022    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 01:05:38.935287 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:38.935260    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b4ed4b-79bc9fd56f-vpg2h"]
Jul 21 01:05:40.079497 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:40.079461    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f3a0a38-f4f6-4747-b164-194f45f1f2a8" path="/var/lib/kubelet/pods/5f3a0a38-f4f6-4747-b164-194f45f1f2a8/volumes"
Jul 21 01:05:40.079872 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:40.079815    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" path="/var/lib/kubelet/pods/9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7/volumes"
Jul 21 01:05:41.099163 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:41.099124    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6fff5"]
Jul 21 01:05:42.733293 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:42.733252    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"]
Jul 21 01:05:42.735189 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:42.735165    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b4ed4b-qttz8"]
Jul 21 01:05:44.079261 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:44.079225    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cda41a90-ee3b-42f7-90ec-78a15f54e2a0" path="/var/lib/kubelet/pods/cda41a90-ee3b-42f7-90ec-78a15f54e2a0/volumes"
Jul 21 01:05:56.620445 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:56.620415    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr_646cc8d9-6b32-476d-a763-54ddbddb5bcd/copy-manifests/0.log"
Jul 21 01:05:56.627485 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:56.627466    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr_646cc8d9-6b32-476d-a763-54ddbddb5bcd/manager/0.log"
Jul 21 01:05:57.368128 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:57.368097    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29743260-7wcdj_60245b59-dafb-4297-8a17-18fd5fd09fd4/cleanup/0.log"
Jul 21 01:05:59.567370 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:05:59.567341    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6fff5_72527586-087e-4141-9cef-ddb71e102e52/limitador/0.log"
Jul 21 01:06:00.174937 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:00.174911    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gk2q7_7c6af712-ed68-4db7-bc79-4e4df2ad465a/discovery/0.log"
Jul 21 01:06:00.916201 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:00.916173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6664cb745d-xdmhp_cee23dac-ca85-43fd-9d0a-3c033aaeaad5/router/0.log"
Jul 21 01:06:01.652982 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:01.652954    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fbmx6k_eb3b6f42-d157-4526-b966-a5eb9ee6323b/main/0.log"
Jul 21 01:06:10.667839 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:10.667791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-w8vwz_49f64862-b311-47a6-b22e-6de917d42ec8/global-pull-secret-syncer/0.log"
Jul 21 01:06:10.779893 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:10.779861    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nlnh6_323fc16c-0d59-4d38-85da-04e3672d279b/konnectivity-agent/0.log"
Jul 21 01:06:10.854590 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:10.854561    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-120.ec2.internal_1bded2ed6bb26343f6cb8a89495340f4/haproxy/0.log"
Jul 21 01:06:16.128094 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:16.128069    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6fff5_72527586-087e-4141-9cef-ddb71e102e52/limitador/0.log"
Jul 21 01:06:18.058292 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.058266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-j6ll5_80c08ff9-979c-4bfd-8d26-ec0c6be89b94/kube-state-metrics/0.log"
Jul 21 01:06:18.079832 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.079809    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-j6ll5_80c08ff9-979c-4bfd-8d26-ec0c6be89b94/kube-rbac-proxy-main/0.log"
Jul 21 01:06:18.102017 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.101994    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-j6ll5_80c08ff9-979c-4bfd-8d26-ec0c6be89b94/kube-rbac-proxy-self/0.log"
Jul 21 01:06:18.133195 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.133171    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-759db7d569-qpf49_7d33e5f5-5d55-49b3-8e9e-cc2857eebe2c/metrics-server/0.log"
Jul 21 01:06:18.640244 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.640213    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8qp4_18d4116c-d859-43c4-bd99-2826d25ba6c9/node-exporter/0.log"
Jul 21 01:06:18.661885 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.661865    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8qp4_18d4116c-d859-43c4-bd99-2826d25ba6c9/kube-rbac-proxy/0.log"
Jul 21 01:06:18.693921 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.693899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r8qp4_18d4116c-d859-43c4-bd99-2826d25ba6c9/init-textfile/0.log"
Jul 21 01:06:18.729523 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.729495    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8p5bm_142ce13c-9fd9-4c92-a5ee-8668e46a501d/kube-rbac-proxy-main/0.log"
Jul 21 01:06:18.758281 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.758261    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8p5bm_142ce13c-9fd9-4c92-a5ee-8668e46a501d/kube-rbac-proxy-self/0.log"
Jul 21 01:06:18.781239 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.781215    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-8p5bm_142ce13c-9fd9-4c92-a5ee-8668e46a501d/openshift-state-metrics/0.log"
Jul 21 01:06:18.815259 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.815238    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/prometheus/0.log"
Jul 21 01:06:18.838005 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.837984    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/config-reloader/0.log"
Jul 21 01:06:18.861883 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.861864    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/thanos-sidecar/0.log"
Jul 21 01:06:18.888447 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.888399    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/kube-rbac-proxy-web/0.log"
Jul 21 01:06:18.911177 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.911159    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/kube-rbac-proxy/0.log"
Jul 21 01:06:18.933522 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.933501    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/kube-rbac-proxy-thanos/0.log"
Jul 21 01:06:18.959588 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:18.959571    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a5777842-c9e2-4866-8a7d-d0625670d17f/init-config-reloader/0.log"
Jul 21 01:06:21.029551 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029512    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"]
Jul 21 01:06:21.029916 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029834    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" containerName="maas-api"
Jul 21 01:06:21.029916 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029844    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" containerName="maas-api"
Jul 21 01:06:21.029916 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029858    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cda41a90-ee3b-42f7-90ec-78a15f54e2a0" containerName="revoke-keys"
Jul 21 01:06:21.029916 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029864    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cda41a90-ee3b-42f7-90ec-78a15f54e2a0" containerName="revoke-keys"
Jul 21 01:06:21.030058 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029920    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a7b08a0-e3d1-46b2-9d88-4469d9fa47f7" containerName="maas-api"
Jul 21 01:06:21.030058 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.029939    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cda41a90-ee3b-42f7-90ec-78a15f54e2a0" containerName="revoke-keys"
Jul 21 01:06:21.033096 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.033066    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.035232 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.035212    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sf6l8\"/\"openshift-service-ca.crt\""
Jul 21 01:06:21.035914 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.035898    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sf6l8\"/\"kube-root-ca.crt\""
Jul 21 01:06:21.035964 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.035898    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sf6l8\"/\"default-dockercfg-pslfp\""
Jul 21 01:06:21.040586 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.040568    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"]
Jul 21 01:06:21.067203 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.067178    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-sys\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.067308 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.067216    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-podres\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.067308 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.067240    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdp68\" (UniqueName: \"kubernetes.io/projected/470a33df-dc96-476a-9f0b-0360dbddaae7-kube-api-access-kdp68\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.067398 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.067311    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-proc\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.067398 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.067350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-lib-modules\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168579 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168553    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-proc\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168730 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168586    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-lib-modules\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168730 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168630    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-sys\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168730 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168652    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-podres\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168730 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-proc\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168730 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168704    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp68\" (UniqueName: \"kubernetes.io/projected/470a33df-dc96-476a-9f0b-0360dbddaae7-kube-api-access-kdp68\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168934 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168732    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-sys\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168934 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168777    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-lib-modules\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.168934 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.168780    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/470a33df-dc96-476a-9f0b-0360dbddaae7-podres\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.176536 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.176517    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdp68\" (UniqueName: \"kubernetes.io/projected/470a33df-dc96-476a-9f0b-0360dbddaae7-kube-api-access-kdp68\") pod \"perf-node-gather-daemonset-44tp7\" (UID: \"470a33df-dc96-476a-9f0b-0360dbddaae7\") " pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.344018 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.343925    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.474477 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.474444    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"]
Jul 21 01:06:21.478047 ip-10-0-141-120 kubenswrapper[2576]: W0721 01:06:21.478015    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod470a33df_dc96_476a_9f0b_0360dbddaae7.slice/crio-7f79c59feae8679eb657330d3603c8e33bc9104bc80ca7d7dd1729a6d0106548 WatchSource:0}: Error finding container 7f79c59feae8679eb657330d3603c8e33bc9104bc80ca7d7dd1729a6d0106548: Status 404 returned error can't find the container with id 7f79c59feae8679eb657330d3603c8e33bc9104bc80ca7d7dd1729a6d0106548
Jul 21 01:06:21.743802 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.743775    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-kr7mn_06ad7b7e-b643-4c69-98e9-0d7f975c7b31/download-server/0.log"
Jul 21 01:06:21.815520 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.815486    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7" event={"ID":"470a33df-dc96-476a-9f0b-0360dbddaae7","Type":"ContainerStarted","Data":"d0889eff2722f7b3e205cdfcd0b64a41a0b1013ece5ed278f8a9f522f8def421"}
Jul 21 01:06:21.815736 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.815540    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7" event={"ID":"470a33df-dc96-476a-9f0b-0360dbddaae7","Type":"ContainerStarted","Data":"7f79c59feae8679eb657330d3603c8e33bc9104bc80ca7d7dd1729a6d0106548"}
Jul 21 01:06:21.815736 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.815610    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:21.830102 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:21.830041    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7" podStartSLOduration=0.830027427 podStartE2EDuration="830.027427ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 01:06:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 01:06:21.829241227 +0000 UTC m=+2968.187230467" watchObservedRunningTime="2026-07-21 01:06:21.830027427 +0000 UTC m=+2968.188016644"
Jul 21 01:06:23.411007 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:23.410976    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbcdd_d14d798c-9089-47a2-b04c-3d662970d855/dns/0.log"
Jul 21 01:06:23.432952 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:23.432928    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bbcdd_d14d798c-9089-47a2-b04c-3d662970d855/kube-rbac-proxy/0.log"
Jul 21 01:06:23.588346 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:23.588308    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8wsn_bb5a13f9-59ec-4300-9180-adeebf1a09e1/dns-node-resolver/0.log"
Jul 21 01:06:24.135650 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:24.135620    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-bdb8bfcf4-dkjq5_de75e08e-f942-4664-9804-5c7ce41323d2/registry/0.log"
Jul 21 01:06:24.188463 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:24.188443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ldgww_4d6adef2-337e-422e-9537-d0838d2c92c1/node-ca/0.log"
Jul 21 01:06:25.306930 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:25.306897    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gk2q7_7c6af712-ed68-4db7-bc79-4e4df2ad465a/discovery/0.log"
Jul 21 01:06:25.529966 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:25.529936    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6664cb745d-xdmhp_cee23dac-ca85-43fd-9d0a-3c033aaeaad5/router/0.log"
Jul 21 01:06:26.217350 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:26.217324    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4dp6c_6167a704-133a-49a1-ba52-4d7d379ca4bf/serve-healthcheck-canary/0.log"
Jul 21 01:06:26.808441 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:26.808411    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flwfg_fc6dc8d5-b640-4d04-8d01-e1b6978d6460/kube-rbac-proxy/0.log"
Jul 21 01:06:26.831202 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:26.831173    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flwfg_fc6dc8d5-b640-4d04-8d01-e1b6978d6460/exporter/0.log"
Jul 21 01:06:26.852891 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:26.852866    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-flwfg_fc6dc8d5-b640-4d04-8d01-e1b6978d6460/extractor/0.log"
Jul 21 01:06:27.830089 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:27.830062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sf6l8/perf-node-gather-daemonset-44tp7"
Jul 21 01:06:30.000414 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:30.000385    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr_646cc8d9-6b32-476d-a763-54ddbddb5bcd/manager/0.log"
Jul 21 01:06:30.025225 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:30.025202    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7dfdb6d6cb-zsdpr_646cc8d9-6b32-476d-a763-54ddbddb5bcd/copy-manifests/0.log"
Jul 21 01:06:31.336529 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:31.336487    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75bcdcf5cd-4ztf9_c8724eac-5e3d-4587-b969-4b9be84b7281/manager/0.log"
Jul 21 01:06:32.263591 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:32.263555    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gk2q7_7c6af712-ed68-4db7-bc79-4e4df2ad465a/discovery/0.log"
Jul 21 01:06:32.410634 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:32.410606    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6664cb745d-xdmhp_cee23dac-ca85-43fd-9d0a-3c033aaeaad5/router/0.log"
Jul 21 01:06:33.692178 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:33.692141    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-gk2q7_7c6af712-ed68-4db7-bc79-4e4df2ad465a/discovery/0.log"
Jul 21 01:06:33.856924 ip-10-0-141-120 kubenswrapper[2576]: I0721 01:06:33.856898    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6664cb745d-xdmhp_cee23dac-ca85-43fd-9d0a-3c033aaeaad5/router/0.log"